{"id":4189,"date":"2024-09-18T15:21:56","date_gmt":"2024-09-18T13:21:56","guid":{"rendered":"https:\/\/aubertm.me\/?p=4189"},"modified":"2024-09-18T15:21:56","modified_gmt":"2024-09-18T13:21:56","slug":"sharing-experience-how-to-gain-from-data-virtualization","status":"publish","type":"post","link":"https:\/\/aubertm.me\/index.php\/2024\/09\/18\/sharing-experience-how-to-gain-from-data-virtualization\/","title":{"rendered":"Sharing experience: how to gain from data virtualization"},"content":{"rendered":"\n<p>I have worked for 9 months as Delivery Manager Denodo at Forem, and developed its virtualized data architecture and governance.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>Data virtualization offers:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A way of reducing the growth of data volume (Microsoft does&#8217;nt like it)<\/li>\n\n\n\n<li>A way of controling the quality of your data (consultants don&#8217;t like it)<\/li>\n\n\n\n<li>A way of having business and IT to better collaborate (some managers don&#8217;t like it)<\/li>\n<\/ul>\n\n\n\n<p>As in any transformation process, enhancement empowers some and dispowers others. A lot of change management is then needed to help the organization&#8217;s digestion.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"a-brief-description-of-denodo\">A brief description of Denodo<\/h2>\n\n\n<p>Denodo basics are quite easy: queries are based on SQL, and the interface is graphical. You can even drag and drop items to create simple queries, that you then combine into complex ones. I gave 2 hours-SQL courses to business users, and they quickly could create their own queries.<\/p>\n\n\n\n<p>Denodo&#8217;s transparency tools allow the vizualisation of data lineage and a complete overview of how the queries were automatically optimized. It&#8217;s easy, it&#8217;s comfy, it&#8217;s trustable.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"db-data-architecture-vs-virtualized-data-architecture\">DB data architecture vs virtualized data architecture<\/h2>\n\n\n<p>Denodo connects to any kind of data sources, and gathers data (see the above scheme).<\/p>\n\n\n\n<p>This virtualized data is flat: it has no connections and no conditions. Only tables remain.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>PRO: you can do whatever you want with it<\/li>\n\n\n\n<li>CON: you can do whatever you want with it<\/li>\n<\/ul>\n\n\n\n<p>You then access to a blank canvas where you can organize your data as needed, in virtual domains and subfolders. Some choose to name their virtual domains after projects, others after physical departments.<\/p>\n\n\n\n<p>Denodo also offers a fully graphical interface with Denodo Data catalog, which allows data filtering. I worked with the Data management team to define categories and tags strategy.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"virtualized-data-governance\">Virtualized data governance<\/h2>\n\n\n<p>Virtualized data sells less Microsoft licenses and less IT consultants hours, it also allows a direct collaboration between business teams and IT teams : it needs a strong top management sponsorship to be able to fully develop .<\/p>\n\n\n\n<p>At Forem, I worked with IT managers to organize an asynchronous virtualized data governance:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>I funded a Data virtualization community, using MS Teams and IRL meetings\n<ul class=\"wp-block-list\">\n<li>together with biweekly distant meetings with virtual domains managers<\/li>\n\n\n\n<li>and trainings in Denodo, in Denodo SQL, in virtual domain management<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>I worked with the Data manager and the BI team to set up handy dashboards for the IT managers to overview how Denodo was used by the teams.<\/li>\n<\/ul>\n\n\n<h2 class=\"wp-block-heading\" id=\"what-ive-learned\">What I&#8217;ve learned<\/h2>\n\n\n<p>Data virtualization is a very virtuous way of decreasing the impact of IT on the environment, but it seems many organizations are not ready yet to adopt it. I am looking forward to Microsoft&#8217;s next moves: Microsoft Fabric is already a step into this direction.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I have worked for 9 months as Delivery Manager Denodo at Forem, and developed its virtualized data architecture and governance.<\/p>\n","protected":false},"author":2,"featured_media":4197,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[4],"tags":[9],"class_list":["post-4189","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-consultancy","tag-en"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/posts\/4189","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/comments?post=4189"}],"version-history":[{"count":0,"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/posts\/4189\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aubertm.me\/index.php\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/media?parent=4189"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/categories?post=4189"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aubertm.me\/index.php\/wp-json\/wp\/v2\/tags?post=4189"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}