Resources - Blog https://www.delphix.com/resources/rss.xml/246 en Part 3: Cloudy with a Chance of Data? Here’s How to Develop a Multi-Cloud Data Fabric Through DataOps https://www.delphix.com/blog/develop-multi-cloud-data-fabric-dataops <span class="field field--name-title field--type-string field--label-hidden">Part 3: Cloudy with a Chance of Data? Here’s How to Develop a Multi-Cloud Data Fabric Through DataOps</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Wed, 11/06/2019 - 15:39</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">Migrating to and managing a multi-cloud environment requires a number of elements to operate smoothly, including your data. Learn key requirements for building a multi-cloud data fabric through a DataOps platform. </div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/matthew-yeh" hreflang="en">Matthew Yeh</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-11-07T14:00:00Z" class="datetime">Nov 07, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-11/multi-cloud_blog_1920x1080_a.jpg?itok=qpMJLkNA 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-11/multi-cloud_blog_1920x1080_a.jpg?itok=NLSFxvfL 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-11/multi-cloud_blog_1920x1080_a.jpg?itok=qVCLlQfj 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-11/multi-cloud_blog_1920x1080_a.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8255"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>Increasingly, more enterprises are relying on multiple clouds to run their unique portfolio of application workloads. For instance, one company might run its production applications in Oracle Cloud while maintaining its dev/test environments for those same applications in Amazon Web Services (<a href="https://www.delphix.com/solutions/aws">AWS</a>). Another business might leverage cloud backup in <a href="https://www.delphix.com/solutions/azure">Azure</a> but use Google Cloud Platform (GCP) for its <a href="https://www.delphix.com/blog/key-ingredient-to-leverage-AI-ML">AI/ML services</a>.</p> <p>The major providers, including Amazon, Google, and Microsoft, offer an increasingly broad portfolio of differentiated services. Taking full advantage of multiple providers means companies need to get a better handle on the data that fuels cloud use cases. Teams need the ability to migrate fast, secure data, provision it to various consumers, and protect it for compliance purposes across multiple clouds.</p> <p>In order to overcome the challenges of managing data in a multi-cloud environment, industry leaders are looking to DataOps as a platform-based approach to grapple with the increasing tension of having to innovate quickly while complying with data privacy regulations. Leading advisory firm <a href="https://www.delphix.com/white-paper/dataops-451">451 Research</a> found that 86 percent of companies plan to increase investment in DataOps strategies and technologies this next year, and 92 percent expect it to have a positive impact on their organization’s success. </p> <h4>Building a Multi-Cloud Data Fabric </h4> <p>Multi-cloud presents an environment fraught with a high level of data friction that stands in the way of fast, efficient data movement. There are more teams in play, more governance policies that need to be in place across multiple geographic regions, different tooling for applications running on diverse and distributed environments as well as an assortment of manual workflows. These are a handful reasons why DataOps is all the more important as a way to cut through friction when it comes to successfully moving and managing data across diverse cloud environments. </p> <p>Central to DataOps is the alignment of people, process, and technology that enables the rapid, automated, and secure management of data. The goal is simple: to eliminate any friction throughout the data lifecycle. Here are the key defining characteristics of a DataOps platform that will empower teams to reap the benefits of multi-cloud: </p> <ul><li><b>Cross-cloud data movement</b>. A DataOps platform allows teams to move data from one cloud to another at speed while keeping data across clouds synchronized.</li> <li><b>Fast data environment provisioning within clouds</b>. The ability to quickly provision data environments can accelerate integration testing of distributed, multi-cloud applications as well as be a source of validation for the workloads that are migrated.</li> <li><b>API-driven automation</b>. Automation will eliminate manual processes and facilitate the integration the integration into DevOps toolchains. </li> <li><b>Governance across clouds</b>. Visibility into data environments across clouds from a single point is extremely important when it comes to understanding where your sensitive data resides. Teams can also determine and specify who has access to what data in the cloud.</li> <li><b>Protect sensitive data</b>. The platform should provide the ability to consistently mask data across clouds in non-production environments. </li> <li><b>Works across heterogeneous environments and data sources</b>. Teams should be empowered to work with data from a diverse set of data sources and securely deliver data to every stakeholder at the speed and scale required to enable rapid development of applications.</li> </ul><h4>Closing Thoughts </h4> <p>In a multi-cloud world, addressing the data layer is more important than ever. Data can no longer exist within isolated silos distributed across multiple clouds/locations, and that’s exactly what <a href="https://www.delphix.com/blog/how-to-find-right-dataops-platform">DataOps</a> is devoted to. Adopting a DataOps platform can help enterprise teams achieve a state of connectedness in which (1) data moves fluidly and securely from anywhere, to anywhere; (2) data is governed in a consistent, holistic manner; (3) and businesses can see and control data through a single platform. Companies are only able to innovate when they can unlock the data they need, and DataOps promises to drive faster innovation by providing access to quality data to those who need it in a self-service environment while maintaining security and privacy controls. </p> </div> </div> </div> </div> </div> Wed, 06 Nov 2019 23:39:42 +0000 michelle 2013 at https://www.delphix.com Calling all SAP ASE Users: It’s Time to Level Up Your Data Ingestion Game https://www.delphix.com/blog/sap-ase-users-level-up-data-ingestion <span class="field field--name-title field--type-string field--label-hidden">Calling all SAP ASE Users: It’s Time to Level Up Your Data Ingestion Game</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Mon, 11/04/2019 - 13:55</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">Learn how to leverage this new functionality of dump history file support to improve your validated sync efficiency and timeflow flexibility—all with the flick of a switch.</div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/ross-millenacker" hreflang="en">Ross Millenacker</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-11-05T14:00:00Z" class="datetime">Nov 05, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-11/istock-467916774.jpg?itok=yJ8rc3Ww 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-11/istock-467916774.jpg?itok=pgKro-tF 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-11/istock-467916774.jpg?itok=WMwInY3g 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-11/istock-467916774.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8252"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>If you are a customer virtualizing <a href="https://www.delphix.com/solutions/ase">ASE</a> data on Delphix, then this post is for you. Dump history, for the purposes of running validated sync, has usurped the venerable backup history log as the new face of validated sync for ASE on Delphix.</p> <p>Earlier this year, in our 5.3.4 maintenance release, Delphix <a href="https://docs.delphix.com/docs534/delphix-administration/sap-ase-environments-and-data-sources/support-for-dump-history-file">introduced a major feature for ASE: dump history file support</a>. The feature marks a great improvement in how Delphix identifies and ingests database dumps, resulting in an improved experience around validated sync and an improved timeflow.</p> <h4>A History Dump on Dump History</h4> <p>Dump history files were introduced in ASE 15.7 SP100 as a means of recording dump database (both full and cumulative) and dump transaction commands that were executed against a database—allowing a much easier recovery mechanism than was previously available (e.g. backup history files). It marked a vast improvement for ASE users and partners to gather rich <a href="http://infocenter.sybase.com/help/index.jsp?topic=/com.sybase.infocenter.dc31644.1600/doc/html/car1397003262021.html">contextual information</a> on DB backups.</p> <p>Parlaying this into the world of Delphix, dump history is a major improvement in how Delphix ingests from source databases using validated Sync, which monitors new backups that are available on a source ASE database. Prior to this, Delphix used backup history logs that worked fine for all intents and purposes, but we anticipate ASE customers to see major improvements with dump history.</p> <h4>Major Benefits</h4> <p>There are two major advantages that come with enabling dump history:</p> <ol><li><b>Greater performance with validated sync</b>. With more detailed metadata (e.g., timestamps, host locations, striping configurations) associated with dump history files, validated sync has far less operational overhead in identifying and ingesting the appropriate backup than what was previously done with backup history. In short, validated sync will run much more efficiently.</li> <li><b>Improved timeflow flexibility</b>. dSource timeflows now have the ability to recover from missed dumps. In the case where a dump is missing (e.g. missed connection or corrupted file), validated sync will pause and continue to look for the missing backup file(s). This process will throw a fault after a number of attempts at locating the correct file but continue to search until the correct file is located. Previously, if a file was missing, validated sync would omit the file and try ingesting an out-of-sequence backup—resulting in a sequence error. </li> </ol><h4>Getting Started</h4> <p>Taking advantage of the improved validated sync for ASE is simple: </p> <ol><li><a href="https://docs.delphix.com/docs/system-installation-configuration-and-management/upgrading-the-delphix-engine/upgrading-the-delphix-engine-an-overview">Upgrade</a> to 5.3.4 or later</li> <li>Verify you’re running ASE 15.7 SP100 or beyond.</li> <li><a href="http://infocenter.sybase.com/help/index.jsp?topic=/com.sybase.infocenter.dc31654.1600/doc/html/car1396029378947.html">Ensure that dump history is active </a>on your source databases </li> </ol><p><i>For more information, check out our documentation center on </i><a href="https://docs.delphix.com/docs534/delphix-administration/sap-ase-environments-and-data-sources/support-for-dump-history-file"><i>ASE dump history here</i></a><i>.</i></p> </div> </div> </div> </div> </div> Mon, 04 Nov 2019 21:55:07 +0000 michelle 2012 at https://www.delphix.com AWS re:Invent 2019 is Approaching at Hyperspeed – Are You Ready? https://www.delphix.com/blog/reinvent-2019-is-approaching <span class="field field--name-title field--type-string field--label-hidden">AWS re:Invent 2019 is Approaching at Hyperspeed – Are You Ready?</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Sun, 11/03/2019 - 11:49</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">It’s that time of the year again when Las Vegas becomes the host of the largest cloud event of the industry. With just a couple of weeks to go, here are a few reasons not to miss Delphix at re:Invent. </div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/jenny-lee" hreflang="en">Jenny Lee</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-11-04T14:00:00Z" class="datetime">Nov 04, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-11/aws-reinvent-2018-e1537975878657.png?itok=oA6nIJy3 1x" media="screen and (min-width: 64em)" type="image/png"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-11/aws-reinvent-2018-e1537975878657.png?itok=i39COUSs 1x" media="screen and (min-width: 48em)" type="image/png"/> <source srcset="/sites/default/files/styles/width_768/public/2019-11/aws-reinvent-2018-e1537975878657.png?itok=UNo1H1Oc 1x" media="(min-width: 0em)" type="image/png"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-11/aws-reinvent-2018-e1537975878657.png" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8244"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>The first week of December is right around the corner and soon tens of thousands of the galaxy’s most elite <a href="https://www.delphix.com/blog/data-ready-for-multi-cloud">cloud</a> practitioners will descend upon Las Vegas for cloud computing’s most anticipated event of the year.</p> <p>Delphix will be returning to cloud city this year<i> Star Wars style</i> and with the full Force of DevOps! As we gear up for a spectacular week at re:Invent, we’ve reimagined the attendee experience to inspire you with revolutionary ways to transform how you build for your customers.  </p> <h4>Catch a Demo at Booth #3623</h4> <p>Whatever part of earth you’re from and wherever you are in your AWS cloud journey, Delphix is here to shift your cloud and <a href="https://www.delphix.com/blog/unleashing-flow-of-data-digital-transformation">digital transformation</a> missions into hyperdrive! Roll by the Delphix booth to speak to our product experts and see demos on how to: </p> <ul><li>Deliver terabytes of data in minutes</li> <li>Provision secure, virtual copies of production for application development, debugging, or migration projects from a variety of SQL/NoSQL/<a href="https://www.delphix.com/blog/delivering-speed-security-to-cloud-native-apps">cloud-native data sources</a></li> <li>Manage your data the way you manage code</li> <li>Automatically profile and <a href="https://www.delphix.com/blog/unmasking-real-value-masked-data">mask</a> sensitive data consistently across heterogeneous data sources and disparate locations </li> </ul><h4>Book a 1:1 DevOps Jedi Mastery Session </h4> <p>Internationally renowned DevOps and cloud transformation leader Sanjeev Sharma will join Delphix this year to train the next generation of DevOps Jedis. He’s had more than two decades of experience helping hundreds of enterprises across the galaxy feel The Force of DevOps.  </p> <p><a href="https://www.delphix.com/event/meet-us-reinvent-2019">Book an exclusive 25 minute session</a> with Sanjeev, so he can assess your current DevOps state and help you wield data like a grand master of the order. </p> <h4>Claim Swag &amp; Experiences Cooler than a Dead Star</h4> <p>Whichever keynotes, technical sessions, and after-hours events you end up attending this year, returning from your re:Invent excursion without some stellar stories and swag would be blasphemous! </p> <p>For the first evening only, you’ll have the opportunity to participate in a Star Wars themed social media photo booth. Snap some photos and transmit them into your social universe to pick up a Fandango Star Wars gift card (<i>while supplies last</i>). </p> <p>Also be on the lookout for our DevOps Jedi Knights, who will be on the show floor with their lightsabers to lead the way to the Delphix booth (#3623 - upper right quadrant, near the Health and Wellness Lounge). Make sure to swing by for some galactic giveaways--including a chance to win a <a href="https://www.delphix.com/event/meet-us-reinvent-2019">Star Wars Millennium Falcon LEGO set</a> and pick up a lightsaber of your own to slash your data migration and <a href="https://www.delphix.com/blog/boosting-data-security-multi-cloud-world">security risks in the cloud</a>! </p> </div> </div> </div> </div> </div> Sun, 03 Nov 2019 19:49:36 +0000 michelle 2009 at https://www.delphix.com It’s Time to Close the Gap on Security and Innovation to Fix Australia’s Data Breach Problem https://www.delphix.com/blog/close-gap-security-innovation-australia <span class="field field--name-title field--type-string field--label-hidden">It’s Time to Close the Gap on Security and Innovation to Fix Australia’s Data Breach Problem</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Wed, 10/30/2019 - 07:34</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">Despite increased pressure from regulators and businesses investing heavily in data security, enterprise leaders are still facing challenges in understanding and responding to data breaches, especially in Australia.</div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/richard-gerdis" hreflang="en">Richard Gerdis</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-10-31T13:00:00Z" class="datetime">Oct 31, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-10/istock-961628368.jpg?itok=eMJ_3dz1 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-10/istock-961628368.jpg?itok=SG-EuT-h 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-10/istock-961628368.jpg?itok=OAQxyl-k 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-10/istock-961628368.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8231"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>Despite increased pressure from regulators and businesses investing heavily in data security, enterprise leaders are still facing challenges in understanding and responding to data breaches. Breaches continue to occur at an alarming rate, especially in Australia. There were a total of 245 reported between April to June of 2019 under the Notifiable Data Breaches (NBD), according to the<a href="https://www.oaic.gov.au/privacy/notifiable-data-breaches/notifiable-data-breaches-statistics/notifiable-data-breaches-statistics-report-1-april-to-30-june-2019/"> Office of the Australian Information Commissioner</a> (OAIC). As the numbers show, even with the pressure of legislation breaches are continuing to occur at the same rate as before with relentless consistency. So why isn’t the current approach to data security working?  </p> <p>The truth is you can’t stop data breaches—they’re inevitable. If you’re a modern company operating in today’s digital age, applications sit at the heart of your business. While building software and applications opens up new opportunities for companies, it also brings about new challenges and a lot more complexity. Building software requires developers to have access to high-quality <a href="https://www.delphix.com/blog/test-data-catalog">test data</a> in non-production environments for developing, testing, and reporting. But security challenges are then amplified because non-production environments are almost always replicas of production environments that contain real data, including confidential information about the organisation, employees, and customers.  </p> <h4>Security and Innovation: Better Together</h4> <p>Security is often thought to be at odds with innovation, particularly given the rate of advancement that many organisations are trying to achieve through <a href="https://www.delphix.com/blog/overcoming-data-friction-to-achieve-devops-success">DevOps</a>. With consumers’ demand for a near-constant cycle of updates and developments more in line with their needs, security can be seen to be more of a hindrance than a help in the race to innovate.</p> <p>But businesses can’t enable data-driven transformation while neglecting data security. Developments in legislation and regulation mean any business that innovates at the expense of security, putting sensitive consumer data at risk, will be heavily penalised through the likes of NDB in Australia and global initiatives like GDPR, as well as potentially having their reputation blemished. Rather than prioritising simply speed, businesses can implement processes that better manage data to reduce risk.</p> <h4>Freezing Innovation – or Thawing it?</h4> <p>While you can never get to zero risk, masking your data minimises your risk of a harmful breach by strengthening data security controls that ensure only the right people have access to sensitive data while still allowing innovation to continue at a fast pace. Should any data fall into the wrong hands, its potential for malicious use is drastically reduced without actual access to sensitive information.</p> <p>The solution to minimising risk lies in one’s choice of <a href="https://www.delphix.com/platform/masking">data masking</a> techniques. Shuffling, for example, results in data that’s anonymised but doesn’t provide insight as it can’t be used in development. Obfuscation, on the other hand, is a better alternative as it allows software development teams to use secure data in their delivery pipeline with speed and efficiency.</p> <p>As organisations look at the rising data breach casualties around the country, they may be tempted to go into “lock-down” and curtail, or even reduce, their digital footprint. That in turn certainly leads to limping behind competitors because of the lack of innovation. Rather than just <a href="https://www.delphix.com/blog/forbes-move-fast-dont-break-things">moving fast</a> and breaking things, businesses can move fast and responsibly with effective data management and security practices.</p> </div> </div> </div> </div> </div> Wed, 30 Oct 2019 14:34:54 +0000 michelle 2006 at https://www.delphix.com Storing a Million Files in a Tiny Box: An Introduction to Filesystems https://www.delphix.com/blog/introduction-to-filesystems <span class="field field--name-title field--type-string field--label-hidden">Storing a Million Files in a Tiny Box: An Introduction to Filesystems</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Wed, 10/30/2019 - 10:28</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">Different operating systems support different file systems. Here’s a quick dive into the world of filesystem allocation, how it works, and what some of the basic tools and techniques are.</div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/paul-dagnelie" hreflang="en">Paul Dagnelie</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-10-30T17:27:42Z" class="datetime">Oct 30, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-10/istock-903139806.jpg?itok=5TCd85nX 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-10/istock-903139806.jpg?itok=3U974Tun 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-10/istock-903139806.jpg?itok=49aqv5yt 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-10/istock-903139806.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8232"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>One of the more common pieces of idle chit-chat people share when attempting to make small talk is the simple-seeming question: <em>So what do you do for a living?</em> Those of you who also work in software will know how quickly answers to this question can go awry when talking to people who aren’t technologically savvy. Recently, I was trying to explain what I’ve been working on lately to my mother. She’s a smart woman, but she has relatively little background in computers and how they work. This is a slightly better version of the analogy I came up with:</p> <p>The filesystem is code that tells your computer how to store all your files. Think of your computer like a vast<span style="font-size: 12.5px;">(1)</span> library. The books are your files on your computer. The shelves and cases and stacks where they’re kept in the library are your hard drive. The filesystem, then, is the team of very helpful librarians who run the place. </p> <p>They have five basic jobs:</p> <ol><li><b>Lookup</b>: finding a given book in the library, or know if it’s in the library at all.</li> <li><b>Reading</b>: fetching the book from a given place.</li> <li><b>Allocation</b>: locating a place for any new books they’re given.</li> <li><b>Writing</b>: putting a book in a given place on the shelves.</li> <li><b>Administration</b>: opening and closing the library; talking to patrons (programs wanting to use your files); transmitting information when everything catches fire.</li> </ol><p>This, as it turns out, is not a bad analogy because filesystems and libraries have a lot in common. They store vast amounts of data, they’re responsible for handing it out and taking care of it, and they need to be relatively efficient about the whole process. Today, we’re going to talk about how filesystems do allocation, what the goals and constraints are, what some of the common solutions are, and how we can make things even better.</p> <h4>Background</h4> <p>In the library-filesystem analogy, a file is a book. Even if it contains a picture, or a song, or a gif of a cat failing to jump onto something, it’s a book. Just like books, files are made of pages<span style="font-size: 12.5px;">(2)</span> (though they’re usually called blocks or sectors). Some files are just one page; others can be many millions. Unlike normal books, files don’t have to stay in one piece when you’re storing them; you can put the first ten pages on one shelf, and then the next ten somewhere completely different if you need to. Of course, if someone asks for the first twenty pages of the book, you’ll have to do some extra walking to fetch them from both places, so it’s usually a good idea to try to keep the pages together as much as possible. </p> <p>In addition, unlike a library, books are constantly being added and rewritten, so it’s very important that the librarians be quickly able to find a place for any new or updated books. The simplest way to find a new place for a book is to just wander around until you find a place to put it. Unfortunately, modern hard drives are so big that this would be extremely slow<span style="font-size: 12.5px;">(3)</span>. What we need is some way to keep track of what space is in use and what space is free that we can use to quickly find a good spot to put a new file in. We’ll call this idea a <i>space map</i>.</p> <h4>Space maps</h4> <p>A space map is a special file in the filesystem that keeps track of what space is in use and what space is available. There are many ways to organize the data in this file to be as compact as possible while still being easy to use. Some modern filesystem store a bitmap; each spot on the shelf is represented by a single 1 or 0—a 1 means it’s in use, and a 0 means it’s free. Since you only need a single bit for each page, you can store a lot of map information in a relatively small file. </p> <p>However, when you need to update the space map with new information, the updates will tend to be randomly scattered across the whole file, which causes performance problems. Another option is to store a list of all the allocated spaces. This works great if you tend to have long stretches of allocated or unallocated space since (<i>almost</i>) no matter how large the contiguous chunk is, it can be stored in a single entry. It works less well if the average chunk size is extremely small. This still has the problem with updates causing a lot of randomly placed writes within the space map.</p> <p>This problem can be solved for both methods with something called a “log-structured space map.” The idea is that you store the normal space map, and then at the end of it you record all the changes you want to make to it in a log. When the log gets to a certain size, you combine it with the normal space map and rewrite the map all at once. This way, all your updates are usually in a few blocks at the end of the file—except every so often when you go through and update the whole map.</p> <p>These maps work great in theory, but having to go to the shelves to look up where there are places to put things every time you need to do an allocation can get very slow. This is where the system’s main memory comes into play, with in-memory space map representations.</p> <h4>In-Memory Representations</h4> <p>If the shelves of the library are your computer’s hard drive, the librarians’ desks are the memory in use by the filesystem. This space can be used to store data that’s being accessed frequently, or store important documents for the librarians themselves. One such document could be the space map. However, even as efficient as these files are, the space map for a whole library is usually too large to conveniently keep in memory. As a result, most filesystems break up the space map into chunks, each representing a different part of the hard drive. </p> <p>Think of it like having a space map for each row of bookshelves. It’s still useful to have one, but it’s of a manageable size. However, we still need to read through the whole space map looking for a good spot, and the whole log as well. We need a more efficient way to store the map while it’s in memory. We’re ok doing lots of random updates since we don’t have to travel very far to do them, but we don’t want to have to take time proportional to the size of the whole map to look for a place to put data.</p> <p>One solution to this problem is called a range tree. This is a data structure that stores a list of all the free spaces on the disk in a quick and easy way to access and update. You can also extend them to make them very good at finding free spaces of a specific size, so you can quickly find a place that your book will fit into.</p> <h4>Putting it all Together</h4> <p>Let’s walk through a typical allocation in a filesystem using the information we’ve learned. </p> <ol><li>First, we go through each of our loaded range trees looking for a space large enough to store the allocation. If we don’t find one, we load a new range tree by fetching the space map from the disk, and then build it into a range tree. </li> <li>We repeat this over and over until we find a place to put the allocation or determine that there is no place big enough. If there’s no big enough place, we can split the allocation into smaller chunks and start from the top. </li> <li>Once we have our place to put the allocation, we remove that space from the appropriate range tree and write out that change to the space map for this part of the disk<span style="font-size: 12.5px;">(4)</span>.</li> </ol><p>You probably have a few lingering unanswered questions, such as:  </p> <ul><li>When we split our space map into chunks, didn’t we reintroduce the problem of having to do lots of writes to different places that we tried to fix with the space map log? </li> <li>How do you pick which chunks to consider first for allocation, and how do you pick which ones to load first? </li> <li>How do you efficiently store and manage your in-memory range trees?</li> </ul><p><em>For more technical details about how this applies to ZFS, <a href="http://open-zfs.org/wiki/OpenZFS_Developer_Summit">register</a> for the 2019 OpenZFS Developer Summit and come check out my talk, or watch it online!</em></p> <hr /><p><br /><sub>(1)<sup> </sup></sub>Vast is the right word; if each page of your average book stores 2000 letters on it, and we think of each letter as being the same as a byte of computer data, then a .1mm thick page stores about 4000 bytes of data (conveniently, almost the same as a modern disk sector!). That means you need about 17 miles of bookshelf to store as much data as a modest 1 TiB hard drive. Even with 6 rows of books on a bookshelf, with walking space between the shelves it takes up an amount of space pretty close to an american football field. And that’s for a single small hard drive!<br /> (2) Books have covers, in addition to just pages. You can extend the analogy to give files “covers”, but it’s not especially helpful and just distracts from the goal here, which is to talk about allocation.<br /> (3) Plus, in a filesystem, there is no simple way to accurately say “this block isn’t in use” just by looking at it; a block filled with zeroes might have been written that way, and changes to it would affect the file it’s a part of. There are workarounds for this, but they require some extra work, and none of them solve the “it would be really slow” problem.<br /> (4)<sup> </sup>Careful readers might note that this step may require another allocation (if we need a new block in the space map log)! Thankfully this is relatively rare, since a single block of the space map log can store a large number of updates. Even if we do need a new block to write this allocation into, that allocation will again probably fit nicely into an existing block, and so on.</p> </div> </div> </div> </div> </div> Wed, 30 Oct 2019 17:28:34 +0000 michelle 2007 at https://www.delphix.com Part 2: Boosting Data Security & Compliance in a Multi-Cloud World https://www.delphix.com/blog/boosting-data-security-multi-cloud-world <span class="field field--name-title field--type-string field--label-hidden">Part 2: Boosting Data Security &amp; Compliance in a Multi-Cloud World</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Mon, 10/28/2019 - 15:45</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">Learn how to win the arms race against potential attackers and achieve compliance while leveraging the unique capabilities across cloud platforms. </div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/matthew-yeh" hreflang="en">Matthew Yeh</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-10-29T13:00:00Z" class="datetime">Oct 29, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-10/istock-1088950364.jpg?itok=Io61cRqp 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-10/istock-1088950364.jpg?itok=_V9wt_i- 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-10/istock-1088950364.jpg?itok=y99T_888 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-10/istock-1088950364.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8215"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>Companies today are striving to become digital enterprises by responding more rapidly to the ever-changing needs of consumers. With that demand for greater speed and agility, IT organizations are looking to the <a href="https://www.delphix.com/platform/cloud">cloud</a> as a fundamental part of their <a href="https://www.delphix.com/blog/5-customers-using-delphix-digital-transformation">digital transformation</a> efforts. </p> <p>For most organizations, that means adopting a multi-cloud strategy that helps teams achieve greater elasticity and faster delivery times, ultimately empowering the business to turn great ideas into winning products and services at lightning speed. While there are a number of reasons businesses pursue a multi-cloud strategy, a key consideration is for security and compliance. </p> <p>Managing compliance obligations and risks are big challenges in a world where every company is becoming a data company. Only 59 percent of companies report they are meeting all or most of the GDPR’s requirements while another 29 percent expect to get there within a year, according to <a href="https://www.cisco.com/c/dam/en_us/about/doing_business/trust-center/docs/dpbs-2019.pdf">Cisco’s 2019 Data Privacy Benchmark study</a>. </p> <p>“Privacy is such a vital ingredient to organizational success, both to protect data and foster innovation,” John N. Stewart, senior vice president and chief security and trust officer at Cisco, added in the report. </p> <p>It’s no surprise that data is the main target of cyber attacks as 2019 shapes up to a landmark year for data breaches. A recent study by cybersecurity firm <a href="https://www.techrepublic.com/article/data-breaches-increased-54-in-2019-so-far/">Risk Based Security</a> found the number of breaches increased by 54 percent in the first six months of 2019 compared to the same time last year. </p> <h4>Keeping up with the Clouds</h4> <p>What many fail to realize is that risk exposure isn't just limited to data associated with operational production applications. It's actually the non-production environments for development, testing, reporting, and analytics that represent most of the surface area of risk. Nearly 47 percent of organizations in the U.S. and Europe already use the cloud for application development and testing, according to a <a href="https://www.cognizant.com/whitepapers/Leveraging-Cloud-for-Non-Production-Environments.pdf">survey</a> by Luth Research and Vanson Bourne. Developers need real data that provides realistic cases for thorough and complete testing. Copying and cloning sensitive information to more and more non-prod environments presents an increased surface area of risk for exposure.</p> <p>This idea extends to (and is perhaps even magnified or complicated by) multi-cloud architectures in which non-production data proliferates across multiple clouds because data is distributed across multiple places instead of one, making it that much harder to secure sensitive information. </p> <p>At the end of the day, the onus of securing sensitive data and ensuring compliance with regulations is on the business. Given the number of businesses that rely on their cloud providers, companies must get a better handle on their data management practices to fully take advantage of adopting a multi-cloud strategy. </p> <p>Here are five reasons why.</p> <ol><li>It’s more challenging to identify all your sensitive data when it’s distributed across locations. </li> <li>Enterprises must protect sensitive data while enabling the appropriate individuals to access it. </li> <li>Laws such as GDPR include data sovereignty provisions that may create requirements to move personal data from one cloud or region to another. </li> <li>Securing data for development and testing purposes must preserve realism and referential integrity of data. </li> <li>Finally, any tooling or processes implemented must work across heterogeneous cloud environments.</li> </ol><p>Let’s apply this to a real-world scenario. Say you’re a global financial service company building a new mobile banking app. Your application could be made up of multiple components spread out over AWS and Azure, each with its own data sources, including membership information, loan product data, and account data. </p> <p>First, teams will need to identify the sensitive information, such as transaction data and social security numbers, that are distributed across multiple non-prod copies in multiple clouds. Then you'd need to secure that data in a way that is preserves the usability of the data. This process will need to be consistent across both <a href="https://www.delphix.com/blog/migrate-sql2008-workloads-to-azure">Azure</a> and AWS and repeatable and fast, so the release process isn't disrupted. </p> <p>Moreover, teams will need to manage that data in accordance with various laws, rules, and regulations by country. This may include the need to move non-production data for the app from one location to another, based on data sovereignty requirements specific to multiple regulations.</p> <h4>Powering Your Multi-Cloud Strategy with Fast &amp; Secure Data</h4> <p>While <a href="https://www.delphix.com/blog/forbes-encryption-wont-protect-against-next-breach">encryption</a> is recognized as a common and familiar method to safeguard sensitive data, it’s not an effective technique when it comes to protecting sensitive information flowing out of downstream environments for development, testing, reporting, and analytics.</p> <p>Companies need to address this challenge by combining modern security practices, like <a href="https://www.delphix.com/blog/securing-enterprise-data-for-applications-in-nonprod">data masking</a>, with the ability to move data quickly across the organization. Data masking replaces real data with fictitious but realistic data that is valuable to testers, developers, and data scientists, whereas encrypted data may not be usable or valuable to those same teams. </p> <p>When data is masked, it has “no value” to a hacker and a compromise is typically a non-event because the masked data is not real. Moreover, masking brings non-production environments that hold most of an enterprises’ sensitive data into compliance with privacy laws such as GDPR and <a href="https://www.delphix.com/blog/are-you-ccpa-ready">CCPA</a>.</p> <h4>The Consequences of Poor Data Protection </h4> <p>Global business leaders are waking up to the paradox of having to ensure data flow in a highly regulated world. Failure to comply can mean millions - if not billions - and failure to innovate can mean bankruptcy. You run the risk of losing customer trust and confidence, brand quality and reputation, as well as the speed required to move fast in today’s ever-changing world. Adopting a data platform that works across multiple cloud providers, identifies sensitive data, and automatically masks that information are important aspects of leveraging the unique capabilities of the multi-cloud, ultimately helping you achieve compliance across heavily regulated industries while mitigating data risk in a way that unlocks innovation.</p> <p><em>Download our <a href="https://www.delphix.com/e-book/developing-multi-cloud-data-strategy">ebook</a> to learn more about how to build a roadmap for moving, governing, and provisioning data for key multi-cloud use cases.</em></p> </div> </div> </div> </div> </div> Mon, 28 Oct 2019 22:45:20 +0000 michelle 2000 at https://www.delphix.com Your Legacy ERP is Holding You Back From Keeping up with Consumers—It’s Time to Invest in Your Data https://www.delphix.com/blog/legacy-erp-holding-you-back-invest-in-data <span class="field field--name-title field--type-string field--label-hidden">Your Legacy ERP is Holding You Back From Keeping up with Consumers—It’s Time to Invest in Your Data</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Thu, 10/24/2019 - 12:24</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">Consumer goods and retail companies can drive ERP innovation using a DataOps platform. Here’s how. </div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/sharon-bell" hreflang="en">Sharon Bell</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-10-24T19:21:25Z" class="datetime">Oct 24, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-10/istock-928414120.jpg?itok=14GfSsuN 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-10/istock-928414120.jpg?itok=tR8ozOdJ 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-10/istock-928414120.jpg?itok=xF338_qv 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-10/istock-928414120.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8204"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>Enterprise resource planning (ERP) systems are often the most expensive IT investment for retail and consumer goods organizations. These applications form the digital backbone of those organization and impact all aspects of business from automating and managing day-to-day activities to integrating core systems with customer-facing processes. </p> <p>But many companies today still struggle with an inflexible ERP system that is not optimized for their business. ERP systems can provide a huge payoff and benefit when enterprises have the ability to convert complex data streams into actionable information in order to optimize business operations and drive better product <a href="https://www.delphix.com/blog/driving-security-and-innovation-together">innovation</a>. Companies must adopt a data management practice that enables a modern and flexible ERP system that rapidly responds to customer needs and new market opportunities. </p> <h4>Overcoming the Data Roadblock</h4> <p>One of the biggest roadblocks to expanding and updating ERP systems is often the manual process of refreshing the mass amounts of data residing within the ERP system and connected front-end technologies, such as point-of-sale systems and ecommerce apps. Manually refreshing those databases for development and end-to-end transaction testing is so onerous that most enterprises only schedule one or two refreshes a year. Consequently, development teams are then constrained to one or two ERP updates a year, or they test with old or fake data sets to increase the frequency of releases, potentially leading to release quality issues and data-related defects. </p> <p>That’s where a <a href="https://www.delphix.com/blog/failure-to-adopt-dataops-can-be-fatal-to-business">DataOps platform</a> can help to enable fast access to production-quality data and accelerate the frequency and accuracy of ERP updates. Through the combination of data virtualization, self-service access to personal data environments, and automated masking of sensitive information, a DataOps platform reduces the time to refresh data from months to days and provides on-demand access to production-quality data for development and <a href="https://www.delphix.com/blog/breaking-from-status-quo">testing</a>. </p> <p>Take <a href="https://www.delphix.com/case-studies/clorox">Clorox</a>, a consumer packaged goods titan, as an example. Clorox teams experienced delays in getting full sets of fresh, secure data, which made it difficult to keep up with SAP enhancements and new features. Testers frequently used stale data, which impacted the QA team’s ability to accurately test transactions across <a href="https://www.delphix.com/blog/deploy-hana-production-4-minutes">SAP</a> and front-end systems, such as its ecommerce platform. Clorox adopted a data platform that allowed them to virtualize the company’s data infrastructure, reducing the time to get data for testing SAP updates and new features from 45 days to just hours. Clorox was ultimately able to accelerate release cycles, enabling IT to react quicker to customer demands and make swift operational adjustments. </p> <p>Similarly, German toy retailer myToys wanted to move from quarterly to daily release updates on Oracle EBS, which ran everything from purchasing, finance, and accounting to inventory management, customer service, and logistics. The ERP team was sharing only two data environments to support the 70+ Oracle projects per quarter, constraining the development process and stifling innovation. They turned to DataOps to provision virtual database copies,  refresh data in hours instead of days, and generate self-service data environments with the right data and application stack for its development and testing teams. As a result, both teams worked in parallel on their personal data environments to achieve their goal of daily release updates. </p> <p>Another obstacle to keeping ERP systems current with the latest innovations is the concern for data privacy. Development and testing teams need massive amounts of data to accurately test software updates and new features, but privacy policies oftentimes prohibit <a href="https://www.delphix.com/blog/top-takeaway-state-of-devops-report">sensitive data</a> from residing in dev/test environments. Without an automated way of masking sensitive information, i.e., credit card numbers, IT teams spend a huge amount of time manually obfuscating data, or developers are forced to create fake data sets. Both activities not only delay development and testing but also negatively impact the quality of software releases.</p> <p>A DataOps platform that includes <a href="https://www.delphix.com/blog/automated-data-discovery">automated data masking</a> can reduce the time it takes to secure data from weeks to hours. Automated masking ensures that sensitive information is turned into realistic, but fictitious data that can be used for development and testing purposes. Secure data can be provisioned and refreshed much faster, thus reducing wait times for engineering teams, compressing testing cycles, and empowering developers to deliver ERP application releases faster and with far greater predictability.</p> <figure role="group" class="caption caption-img"><img alt="Data Masking" data-entity-type="file" data-entity-uuid="200611b0-5b90-441a-b0c0-54e820e0272b" src="/sites/default/files/inline-images/masking_0.png" /><figcaption>Example of masking</figcaption></figure><h4>Accelerating ERP Innovation with Fast and Secure Data </h4> <p>IT and <a href="https://www.delphix.com/blog/confessions-developer">development teams</a> must work together to ensure that data does not become the bottleneck to modernizing the ERP systems. This involves both process and people transformation as well as a technology like a DataOps platform that provides data virtualization, referential masking as well as self-service access to data for dev/test teams. </p> </div> </div> </div> </div> </div> <div class="field field--name-field-tags field--type-entity-reference field--label-inline"> <div class="field__label">Tags</div> <div class="field__items"> <div class="field__item"><a href="/tags/dataops" hreflang="en">DataOps</a></div> </div> </div> Thu, 24 Oct 2019 19:24:18 +0000 michelle 1996 at https://www.delphix.com Delphix Partner Spotlight on EVOTEK https://www.delphix.com/blog/partner-spotlight-evotek <span class="field field--name-title field--type-string field--label-hidden">Delphix Partner Spotlight on EVOTEK</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Tue, 10/22/2019 - 13:26</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">EVOTEK is an award-winning enabler of secure digital business based in San Diego, Calif. We spoke with Dustin Millberg, CTO of EVOTEK Labs and Executive Director of Platform Engineering about the innovative ways the company provides technology leadership to their national customer base.</div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/lenore-adam" hreflang="en">Lenore Adam</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-10-22T20:25:28Z" class="datetime">Oct 22, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-10/partnerspotloght_evotek_blog-1920x1080.jpg?itok=WvQwIgie 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-10/partnerspotloght_evotek_blog-1920x1080.jpg?itok=NasbJ5I3 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-10/partnerspotloght_evotek_blog-1920x1080.jpg?itok=DIS5mhbO 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-10/partnerspotloght_evotek_blog-1920x1080.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8199"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><h4>Tell us a bit about EVOTEK and the broad range of services you bring to enterprise customers.</h4> <p>The key for us is in our understanding of how our customers consume technology resources.  In order to provide strategic value in supplying infrastructure, we have to better understand how they are consumed. EVOTEK’s unique, consultative approach enables us to better understand how an organization is developing and delivering modern platforms. From this insight, we help customers implement the practices required to transform their data centers, adopt modern software development methods, and build out initiatives like AI.</p> <p>The EVOTEK Platform Engineering practice focuses on four key disciplines:</p> <ul><li>Building CI/CD pipelines by identifying the people, processes, and tools needed to deliver software in an automated workflow. </li> <li>Refactoring existing software into a modern microservices-based architecture, enabling the optimization of workloads at scale.</li> <li>Through containerization and orchestration, we enable organizations to make services immutable, workloads ephemeral, and the consumption of infrastructure ubiquitous.</li> <li>Embedding security by design into software development practices results in more secure platforms. With automation, everything is code. Companies must ensure their  software design, development, and delivery is secure via  a platform that is not only built for scalability but also for traceability.   </li> </ul><p>Our customers are primarily based in the U.S. across a variety of markets, including healthcare, finserv, technology, and more. We focus on solving the larger problem of building a scalable platform infrastructure which is a ubiquitous challenge, so our four key disciplines are applicable to any industry.</p> <h4>How would you describe your typical planning process with customers as you help them transition a holistic platform approach through automation?</h4> <p>No two organizations are the same. Deep understanding of the environment is critical to presenting strategic solutions. We analyze both the application and platform architecture to understand what customers are doing today, where they want to be, and what the barriers and blockers are. Based on that analysis, we are able to advise and architect scalable solutions tailored to meet each customers’ unique needs. The end goal is to ensure their platform can scale more effectively—no matter where their infrastructure lives.</p> <p>We’re really focused on understanding and implementing the entire process. Most organizations have technical debt to deal with, and they also have process problems that need to be streamlined. We analyze the software delivery lifecycle from ideation to implementation with a fresh set of eyes and determine how to not only optimize but do it securely.</p> <h4>With large-scale transformations, you must find customers at different levels of maturity.  What do you see in terms of the  customer journey?</h4> <p>About 20 percent of our customers are very mature and as a result need help with a discrete problem. On the flip side, another 20 percent is far behind the curve, so there’s a lot of education necessary when creating a comprehensive plan. The remaining  60 percent is an interesting mix. Many IT leaders believe they can develop a data delivery and security solution themselves, so they spend six to nine months trying to build one in-house. But it turns out that solving their pain points in-house is much more difficult than many organizations understand and can realistically undertake. More often than not, they come to the realization that partnering with organizations, like Delphix—who have years of experience solving these specific challenges— deliver a higher value service in a shorter period of time than executing internally.</p> <h4>In what ways does our partnership benefit customers?</h4> <p>As we distill the customer’s architecture and develop a plan to transform and enable it in a secure way, data management and data security play key roles.</p> <p>We embed the Delphix platform into the CI/CD pipeline, automating the delivery of data for dev and test teams, so they can spin up ephemeral workloads on demand. With easy access, they can leverage data that mimics production, so shift-left testing finds data-related defects earlier. </p> <p>We also help our customers establish a cloud strategy that optimizes spend and creates a more secure platform. Sound security practices include securing the data delivered to data consumers, and Delphix masks data delivered to dev and test teams to ensure our customers maintain regulatory compliance.</p> <p>All of our customers are regulated in some way for data privacy. To comply with these regulations, application security is important, but it’s ultimately the data that needs to be secure.  Delphix masking gives them the ability to do that.</p> <p>Through our partnership, we can offer our customers the ability to ensure data is usable, and secured, in any environment.</p> <h4>With your comprehensive, end to end focus, you must work with a range of people…from dev to ops, and from practitioners to execs.</h4> <p>Yes, that’s true. Given our four primary disciplines, the CIO and CTO are involved in every aspect of the process. The CSO is brought in to the process as we refactor applications and redesign the software delivery pipeline. DevOps engineers, site reliability engineers, DBAs, or data engineers are all engaged in designing and implementing the transformation. By taking a DevOps approach, our team is able to remove silos from workflows and decision making while establishing visibility and collaboration to foster a culture of continuous improvement.</p> <h4>What do you think has been the secret to your success?   </h4> <p>Many systems integrators today sell infrastructure but don’t offer consulting services or the depth of expertise required to create a long term plan. At EVOTEK, we truly provide a holistic approach to digital transformation. We look at every aspect, including people, processes as well as the technology to provide solutions for the entire platform. If we’re the tool belt so to speak, Delphix gives us the best tool for fast and secure data delivery.</p> <p> </p> <p><b>About Dustin Milberg</b><br /> Dustin is a seasoned enterprise technology executive who has served as a CTO/CIO and VP of Engineering. He leads EVOTEK’s Labs and Platform Engineering practice, helping customers adopt a holistic approach to developing and delivering sustainable platforms and solutions, while enabling technology organizations to optimize the entire operation: people, process, infrastructure, operations, development, quality, and security. Many of EVOTEK’s customers are in the process of investigating the cloud and trying to determine right the consumption models to fit their needs. Dustin is working with technology leaders and engineering teams to develop and execute on sound, scalable technical strategies providing the best performance and cost. His broad and deep experience uniquely position Dustin to provide value at all levels within technology organizations, with heavy emphasis on helping leaders navigate and transform the ever-changing technical landscape.</p> <p><b>About EVOTEK</b><br /> EVOTEK was founded to pursue a disruptive new vision: to provide technology leadership on innovative ways to safely thrive in a digital world. With technology offerings from data center to cloud, EVOTEK is uniquely equipped to enable customers with the industry shift from traditional IT computing to secure multi-cloud. With services practices in cybersecurity, mobility, platform engineering and artificial intelligence, EVOTEK is moving up the value chain, closer to the part of digital business that matters most. EVOTEK was named to Inc Magazine’s Best Places to work in 2018. In 2016, 2017 and 2018, EVOTEK was named to The San Diego Business Journal's Best Places to work and recognized in CRN's Solution Provider 500 list, CRN's Next-Generation 250 list, CRN’s Triple Crown and highlighted as CRN's Top 150 Growth Companies, holding the #1 spot in 2017, as the fastest growing system integrator in the country.</p> </div> </div> </div> </div> </div> Tue, 22 Oct 2019 20:26:35 +0000 michelle 1995 at https://www.delphix.com Delphix Partner Spotlight on FWD View https://www.delphix.com/blog/partner-spotlight-fwd-view <span class="field field--name-title field--type-string field--label-hidden">Delphix Partner Spotlight on FWD View</span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Fri, 10/18/2019 - 13:45</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">In our newest partner spotlight, we spoke with James Heath, managing director at FWD View, a DataOps technology company that focuses on bringing solutions to the financial and commodity markets across Europe and South Africa. </div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/lenore-adam" hreflang="en">Lenore Adam</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-10-18T20:45:33Z" class="datetime">Oct 18, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-10/partnerspotloght_fwdview_blog-1920x1080.jpg?itok=JBTaIA1h 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-10/partnerspotloght_fwdview_blog-1920x1080.jpg?itok=uvhlyKx9 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-10/partnerspotloght_fwdview_blog-1920x1080.jpg?itok=Efa3gKjP 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-10/partnerspotloght_fwdview_blog-1920x1080.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8187"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>Based in London, <a href="https://fwdview.com/company-2/">FWD View</a> is a DataOps technology company that focuses on bringing solutions to the financial and commodity markets across Europe and South Africa. Their client base includes investment banks and hedge funds, as well as commodity trading. In our newest partner spotlight, we spoke with James Heath, managing director at FWD View.</p> <h4>The financial industry is a common bellwether for technology disruption. How are you leading that disruption with DataOps? </h4> <p>DataOps is a broad term that encompasses multiple aspects of data transformation. Our approach is to help our clients automate the flow, improve the quality of, and reduce the timecycle of data across an organization.</p> <p>We feel enterprise digital transformation involves a data journey, so our DataOps practice helps our financial customers curate, catalog, organize, manage, secure, and extract value from their data.  We focus on three specific areas for our financial clients: application acceleration, security and compliance, and data portability to achieve specific business outcomes.</p> <h4>What are the ways you’re helping clients transform their data-related workflows?</h4> <p>Our financial clients have legacy technology to deal with, and they not only need new tools, but they also need to transform database delivery processes and development workflows. Our role is to understand and integrate all the tools needed to create new workflows that increase agility and release velocity.</p> <p>For example, we do a lot of work around the large vendor trading applications, which are monolithic, heavily customized, and complex. About 90 percent of banks globally use vendor trading apps like Murex, Calypso, and Finastra, and they represent business-critical systems. The level of customization and integration means that implementing, upgrading, and maintaining these applications is very expensive in a world that is moving to the cloud and has high demand for environments (particularly at project time). Delphix hits a real sweet spot for our clients as the platform removes the data bottlenecks that make environment/config management, test data management, and data migration a real challenge.<b> </b></p> <p>All of our clients have some form of agile, CI/CD, or DevOps transformation underway and the piece that’s more often left behind is data. We help our clients to integrate Delphix into their existing DevOps toolchain, often redesigning application build processes through a DataOps lens.</p> <p>Let’s say a client needs an update in their customized accounting module of Murex. This represents millions of transactions and can take 9-12 months to successfully execute the upgrade. In a project like this, most of the issues occur at the integration touch points, and the process creates a huge demand on test environment creation.  </p> <p>Delphix fits well here because we help our customers progress their workflows to the point where dev and test teams can spin up their own test environments on-demand. With dev/test provisioning on-demand and having self-service control to branch and rewind data sets, we can increase the speed of an upgrade by 30 percent. Even with a small to medium size Murex installation, this can result in $1.5m in savings. An added bonus is the virtual copies significantly reduce storage costs, and banks are keen to avoid additional investment in infrastructure. </p> <h4>Data security is one of the biggest issues facing businesses today, especially in the financial sector. How are you helping customers address this challenge? </h4> <p>Data security is right towards the top of almost every CIO’s agenda in the financial markets. Security no longer concerns itself solely with infrastructure, networks, and firewalls. We’re helping our clients build data-centric security models, setting up the toolchain as well as implementing and integrating complementary software. Delphix plays a huge role as it offers our clients the ability to dynamically mask sensitive data. This means our clients are able to maintain high levels of agility without sacrificing security. The capability to rapidly deliver multi-terabyte, end-to-end environments that are masked with referential integrity is a real game-changer, particularly as so many of our clients are commencing their journey to the Cloud.</p> <h4>Can you give us an example of how you deliver value to your customers? </h4> <p>With many years of experience in the financial markets and working on DataOps initiatives, we are in a position to help our clients plan for the future and grow their overarching data strategy.  How can you use data to make better business decisions and more accurately manage risk?  Where is the data needed to achieve these business outcomes? Is it accessible, secure, and portable?  </p> <p>Our clients are making important business decisions, but nearly 30 percent of their data is “dark,” meaning unusable. Banks have been storing and securing vast amounts of dark data for years (usually for compliance purposes) and failing to organize technology and processes to efficiently use this data for other purposes, such as analytics. We always find it interesting when some of our clients start talking about AI and  robotics, when often they don’t even know what data they’ve got, where it is, who it belongs to, how accessible or secure it is. An enterprise DataOps approach facilitates important initiatives like this.</p> <p>We help our customers to first discover, catalog, organize, and manage all their data. With this foundation in place, the second step is to institute data governance for access and control.  From here, they are ready to start planning for the future and start talking about what they want to achieve for the business.</p> <h4>In what ways does our partnership benefit customers? </h4> <p>We work a lot on DevOps and cloud initiatives. Trading applications are rarely cloud-ready. It can cost millions of euros to re-orchestrate a client’s trading app for the cloud but they will realize tremendous benefits by migrating test environments to the cloud. Our guidance is to first move non-production data to the cloud to gain the efficiencies and flexibility inherent in a cloud architecture. Once they demonstrate that they can move and secure data, they are able to create the framework and toolchain for a future move of production data to the cloud.</p> <p>We also work with our clients to develop a multi-cloud strategy. Delphix provisions masked virtual copies of the production database to test environments to facilitate a DevOps toolchain in the cloud. Delphix fundamentally addresses three core risks that are associated with large scale cloud migration: ensuring and enabling business continuity, avoiding vendor lock-in, and establishing security through the ability to keep huge amounts of data portable and dynamically masked.</p> <h4>What are the services you offer with Delphix? </h4> <p>FWD View provides professional services that encompass a broad range of capabilities, such as analyzing technical prerequisites, creating a procurement cross charge model, as well as configuration and installation. We build a framework that expedites the sale and installation of the Delphix platform, then continue to drive further adoption and enablement within the account. Really, we manage the end to end process from lead generation, pre-sales support, sales, project, and managed services. Our value comes in the fact that we understand the applications, domain, and core objectives our clients are looking to achieve within the industry.</p> </div> </div> </div> </div> </div> <div class="field field--name-field-tags field--type-entity-reference field--label-inline"> <div class="field__label">Tags</div> <div class="field__items"> <div class="field__item"><a href="/tags/dataops" hreflang="en">DataOps</a></div> </div> </div> Fri, 18 Oct 2019 20:45:54 +0000 michelle 1990 at https://www.delphix.com Part 1: The Multi-Cloud Era is Here to Stay. But is Your Data Ready? https://www.delphix.com/blog/data-ready-for-multi-cloud <span class="field field--name-title field--type-string field--label-hidden">Part 1: The Multi-Cloud Era is Here to Stay. But is Your Data Ready? </span> <span class="field field--name-uid field--type-entity-reference field--label-hidden"><span lang="" about="/u/michelle" typeof="schema:Person" property="schema:name" datatype="">michelle</span></span> <span class="field field--name-created field--type-created field--label-hidden">Mon, 10/14/2019 - 08:33</span> <div class="field field--name-field-teaser field--type-string-long field--label-hidden field__item">The future isn’t the cloud, it’s multi-cloud. Matthew Yeh shares key data challenges IT teams must overcome when mapping a multi-cloud strategy. </div> <div class="field field--name-field-author field--type-entity-reference field--label-hidden field__item"><a href="/author/matthew-yeh" hreflang="en">Matthew Yeh</a></div> <div class="field field--name-field-date field--type-datetime field--label-hidden field__item"><time datetime="2019-10-14T15:31:24Z" class="datetime">Oct 14, 2019</time> </div> <div class="field field--name-field-media field--type-entity-reference field--label-hidden field__item"><article class="media media-image view-mode-page-heading media--type- media--unpublished"> <div class="field field--name-thumbnail field--type-image field--label-hidden field__item"> <picture> <!--[if IE 9]><video style="display: none;"><![endif]--> <source srcset="/sites/default/files/styles/width_480/public/2019-10/multi-cloud_blog_1920x1080_c.jpg?itok=kQDnHz75 1x" media="screen and (min-width: 64em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_1024/public/2019-10/multi-cloud_blog_1920x1080_c.jpg?itok=qg3rW3op 1x" media="screen and (min-width: 48em)" type="image/jpeg"/> <source srcset="/sites/default/files/styles/width_768/public/2019-10/multi-cloud_blog_1920x1080_c.jpg?itok=BhXeo5hs 1x" media="(min-width: 0em)" type="image/jpeg"/> <!--[if IE 9]></video><![endif]--> <img src="/sites/default/files/2019-10/multi-cloud_blog_1920x1080_c.jpg" alt="Thumbnail" typeof="foaf:Image" /> </picture> </div> </article> </div> <div class="field field--name-field-components field--type-entity-reference-revisions field--label-hidden field__items"> <div class="block-text " id="paragraph-8101"> <div class="container"> <div class="block-text__content"> <div class="clearfix text-formatted field field--name-field-content field--type-text-long field--label-hidden field__item"><p>Organizations today are adopting cloud-based applications, platforms, and services to achieve greater elasticity and faster delivery times in today’s app-driven world. In fact, 98 percent of organizations expect to operate within a multi-cloud environment by 2021, according to <a href="https://www.ibm.com/thought-leadership/institute-business-value/report/multicloud">IBM</a>. Of course, every enterprise is different, and there are varying reasons, priorities, and use cases when considering the move to multi-cloud. </p> <p>As the name suggests, adopting a multi-cloud strategy means using multiple cloud services from different providers, with workloads spread out across cloud environments. The emergence of multi-cloud aligns well with the trend in application architectures towards the deployment of loosely coupled components that, together, constitute a cohesive unit. </p> <p>Compared to monolithic approaches, leveraging microservices and APIs spread out across multiple clouds affords organizations far greater flexibility, reuse opportunity, and extended reach to choose the best available cloud services. But not every team, business function, or application workload will have similar requirements in regards to performance, privacy, security, or geographic reach for its cloud environment. </p> <h4>Preparing for a Multi-Cloud World</h4> <p>While most businesses require rapid and flexible access to computing, storage, and networking resources that can meet the needs of legacy applications and modern cloud innovations, not all enterprises are pursuing multi-cloud for the same reasons. Intentions may be motivated by regulatory concerns, as a hedging strategy and avoid unwanted vendor lock-in, or to build an optimal business solution by leveraging the best-of-breed services.</p> <p>Whatever the impetus, companies must build a culture that puts data front and center in a world where every company is becoming a data company. This leads us to our main points: understanding key data challenges and getting your data ready for multi-cloud environments. </p> <h4>Defining a Data Strategy for Multi-Cloud </h4> <p>Migrating large volumes of data to the cloud or across clouds is not an overnight process or a one-time trip; it’s quite the opposite. And once that data has been delivered, provisioning or refreshing data for consumption by developers, testers, or cloud services is often a slow and iterative process, involving multiple teams. </p> <p>The fact that data is distributed across multiple databases, including relational and non-relational, as well as a number of locations (on-premises and multiple clouds) complicates workflows that can already take days, weeks, or even months. </p> <p>A <a href="https://www.delphix.com/white-paper/dataops-451">confluence of factors</a> – including data security, privacy, quality, and access, among many others – makes data management extremely hard. Hence, organizations need to pull together a seamless data management strategy that will integrate disparate cloud services and automate the movement of fast, secure data across their cloud ecosystems in order to fully experience the benefits of going multi-cloud.  </p> <h4>Building A Multi-Cloud Data Fabric: Key Challenges</h4> <p>Although 98 percent of organizations expect to operate within a multi-cloud environment by 2021, just <a href="https://www.ibm.com/thought-leadership/institute-business-value/report/multicloud">38 percent</a> have in place the procedures and tools needed to operate in such an environment. To build a multi-cloud data fabric, data teams need to bring in new technologies to enable the rapid, automated, and secure management of data in the cloud. </p> <p>There a number of data-related challenges that come with multi-cloud adoption. </p> <ol><li><b>Heterogeneous data sources</b>: Multi-cloud architectures often encompass a distributed set of applications or services that run on a diverse set of underlying data sources including RDMS, NoSQL, or PaaS offerings native to specific clouds. Businesses need the tooling (as well as the talent) to use these various sources and harmonize their operations.   </li> <li><b>Slow, manual migration processes:</b> Securely migrating large volumes of data to cloud providers can take weeks— and sometimes even involve the shipment of a physical appliance. Moreover, applications may have requirements to keep data across clouds synchronized or fresh, meaning data movement across clouds is not a one-time migration. It must be continuous.</li> <li><b>Slow data provisioning for testing</b>: Many multi-cloud scenarios create requirements for rapid, iterative testing that drive demand for test data availability. For instance, when migrating application workloads from one cloud to another, IT teams need new data environments for validation and cutover rehearsal. Or if QA is testing composite applications with components/services that are distributed across multiple clouds, he or she will need data environments (potentially derived from multiple data sources) for integration testing.</li> <li><b>Visibility</b>: Teams need visibility into data environments across clouds from a single point that establishes who has access to what data in the cloud. It’s critical to know where what data resides and have the ability to control access, movement, retention in an expanded cloud environment. Hence, the processes and tools for understanding and controlling data environments must be standardized in a way that works across multiple clouds.</li> <li><b>Securing data in the cloud</b>: The surface area of risk for sensitive data potentially increases with multi-cloud, and the number of people with access to data may increase as well. Teams need an approach for finding and securing confidential information — to mitigate the risk of breach and stay compliant with privacy regulations, such as the GDPR and CCPA.</li> </ol><h4>Putting Your Data on ‘Cloud 9’</h4> <p>The multi-cloud era is upon us. On average, organizations are leveraging almost <a href="http://googliers.net/static/media/uploads/download_files/2019_state_of_the_cloud_report.pdf">five clouds</a> across both public and private. While the promise of driving greater operational efficiency, productivity, agility, flexibility, and profitability are luring more organizations to adopt the cloud, IT leaders must consider addressing data-related challenges first in order to successfully build and manage their multi-cloud strategy. </p> </div> </div> </div> </div> </div> Mon, 14 Oct 2019 15:33:17 +0000 michelle 1979 at https://www.delphix.com