Dell EMC expands Hadoop choices with a Hortonworks offering

first_imgCustomers continue to hear about the digital transformation and the effect it will have on their business. The digital transformation is causing churn, uncertainty and disruption for many business leaders, who must act as the pressure is increasing from all directions. Big data and analytics will be at the core to enable this transformation, and Hadoop is a foundational component of a big data and analytics solution stack.While the Hadoop platform offers unique value for organizations seeking to capitalize on big data, it can be a challenge to implement. At Dell EMC, we give you the option to buy your Hadoop ecosystem or build it out yourself. We recognize that the upfront work to build it yourself can be time-consuming and labor intensive. One way we help is to address those challenges by providing certified Hadoop solutions and the expertise needed to accelerate your time to value.In addition, the Dell EMC approach to Hadoop solutions recognizes that organizations considering big data and analytics solutions like to have a choice of technologies and the assurance of proven, validated configurations. That’s the idea behind Dell EMC solutions for big data and analytics.The growing Dell EMC portfolio includes a new tested, validated solution for the Hortonworks distribution of Apache Hadoop. This solution brings together all of the components of a robust Hadoop DAS environment based on Hortonworks software, Dell EMC PowerEdge R730xd servers and Dell Networking. Dell EMC does all the hard upfront work, allowing your organization to focus on putting Hadoop to work to enable deeper insights and enhanced data-driven decision making.The newly released solution helps your team simplify and accelerate the design and implementation of a trusted Hortonworks Hadoop environment — so you can start realizing business value much faster. Along with this proven architecture, Dell EMC provides the guidance and know-how you need to build a Hadoop cluster from bare metal hardware.Dell EMC also offers validated configurations that pair the Hortonworks platform with Dell EMC Isilon scale-out network-attached storage systems, for massively scalable big data storage with robust analytics, and the Pivotal Greenplum database for analytics-optimized SQL on structured data. And, of course, Dell EMC also has several offerings that incorporate the Cloudera distribution of Hadoop, ranging from preconfigured plug-and-play appliances to validated and engineered solutions.You can test drive any of these offerings in a Dell EMC Customer Solution Center. These state-of-the-art technical labs enable Dell EMC customers to explore, architect, validate and build solutions, from the data center to the edge of the network, to drive toward targeted business outcomes.Take a closer look at the offerings in the Dell EMC portfolio at Dell.com/Hadoop and EMC.com/BigData.last_img read more

Achieve Efficient Energy Management through Digitization

first_imgThe components of the Dell EMC infrastructure include the Dell Edge Gateway for the intelligent capture of all relevant measurement data from the production plant, and the compute power of Dell EMC PowerEdge Server with Intel® Xeon® processors, in combination with Dell EMC Storage and Networking products. To deploy infrastructure technology quickly when needed, Dell EMC offers Ready Solutions that are optimized for SAP HANA. The SAP-certified and pre-configured Dell Edge Gateway connects varied wired and wireless devices and systems, aggregates and analyzes the input, and forwards it to the SAP HANA platform for further analysis. Because the gateway sits close to the devices and sensors, it sends only meaningful data to the cloud or control center, saving expensive bandwidth.INTENSE AG’s Energy Efficiency Solution (ESS) provides the following capabilities:Capture, manage, evaluate and display all energy-specific measurement data, influencing factors, and relevant comparison values ​​from SAP and from external systemsDerivation of the energy baseline (EnB) as well as relevant energy performance indicators (EnPi’s), graphical visualization, location comparisons and forecasts as well as alarm functionsIdentification and management of potential options for energy efficiency and the introduction of appropriate measuresIn addition, ESS is able to determine parameters for optimizing energy consumption based on historical data. This results in the following advantages for an organization:Identification of energy optimization options in plants and production processesReduction of energy consumption and related energy costsCompliance with government requirements for energy efficiencyIncreased production efficiency on the basis of dependencies between production and energy useOverall, the energy efficiency solution approach from Dell EMC and INTENSE leveraging SAP HANA covers a broad range of industries. These include not only manufacturing companies, but also health care facilities, universities and operators of large building complexes.Conclusion The efficient energy supply of the future is closely linked to digitization. It is the basis of an intelligent energy management system. The goal is to optimize and to sustainably reduce energy consumption for consumers. This results in economic benefits, especially for the manufacturing sector. Digitization using IoT technologies enables them, for example, to adapt manufacturing power to the energy supply capacity and thus to save costs.The solution approach from Dell EMC and INTENSE plays a key role here. It fulfills all prerequisites for a viable and efficient energy supply for all organizations.To learn more about the Energy Efficiency Solution, read the white paper and visit the Dell EMC booth at the SAP Leonardo LIVE on 11 and 12 July 2017 in Frankfurt or get in contact directly with our experts from the Dell EMC Global SAP Center of Excellence. Globally, organizations have set themselves the goal of reducing their energy consumption and CO2 emissions. In 2010, for example, the European Commission has defined regulations and guidelines for an expanded, environmentally friendly energy strategy. An essential part is efficient energy management, in which digitization is the key to success.Limited reserves of fossil fuels such as coal, natural gas and oil, unpredictable risks of nuclear energy, environmental factors and steadily rising energy costs are drivers of a long decided energy transition. Current and future strategies are therefore primarily based on the use of renewable energies as well as resource-conserving concepts of energy use.For the energy producers in Germany, this means primarily to switch to solar and wind energy, but also to bioenergy, geothermal energy and hydroelectric power. For energy consumers, especially in the manufacturing sector, the optimization of energy use must be achieved by means of effective energy management with tailored IT solutions.Energy supply for manufacturingLucrative subsidy programs, such as from the German government, are leading to an increasing acceptance of renewable energies not just in private households. In addition to municipalities, the manufacturing sector is increasingly using renewable energies for its production process. But office buildings, hospitals and universities also increasingly rely on resource-conserving energy. In addition, the public pressure of consumers in terms of ecological footprint and legal incentives contributes significantly to the trend reversal.Thus, a first goal has already been achieved today: In Germany, electricity generation from renewable energies is of great importance, also for companies. Well-known examples are Deutsche Bahn and Posteo. The share of renewable energies in the total electricity generation in Germany is now almost one third. The goal is that this share will increase to about fifty percent by 2025.Challenges put to the testA major challenge of the energy supply for production plants is to be able to control and optimize their energy requirements at any time. In addition to cost savings, this is primarily a result of government regulations and standards, such as the energy efficiency guidelines in the European Union. Not only in Germany, but worldwide, organizations are working on innovative solutions to meet this challenge and thus optimize the use of energy.In this respect, the energy suppliers are also required to adapt and integrate existing energy supply systems to extreme or unforeseen changes in energy production.The limited storage capacity of energy media under technological and economic constraints, in combination with the high fluctuation of regenerative energy generation systems, considering stable distribution systems and limited predictability of the current and future sales situation, are factors in creating highly complex technological requirements for producers and network operators.Environmental awareness and manufacturing successThe use of renewable energies in an organization shows its positive environmental awareness. Efficient energy use and associated cost savings contribute to its economic success. Deviations of the expected energy input are an indicator of potential for optimization in the production process. This is the technical challenge – to find a comprehensive solution that every organization can use for its own purpose:Energy consideration of individual production plants taking relevant influencing factors into accountOrganization-wide comparison and cumulative approach optionsComplete integration of energy management into production, material management, forecast, purchasing, etc.Flexible adaptability due to changed order and utilization conditions.It is important to manage the complexity of energy production, consumption, storage and distribution in such a way that the energy supply is robust and the risk of a damage is minimized. It is also important that the solution utilized reacts in real time, to process the relevant data in a user-friendly and meaningful way and serve as the basis for production and business decisions.Energy management through digitization and Internet of ThingsTo address these challenges, Dell EMC and INTENSE AG are collaborating on an end-to-end solution approach for organizations based on:Energy Efficiency Solution (ESS) software suite from INTENSE AG,The analytical capabilities of the SAP HANA® platform with complete integration into an organization’s ERP, andA powerful Dell EMC infrastructure for capturing, storing and analyzing the data.last_img read more

Making the Most of Data – and the Opportunity it Represents

first_imgDell EMC is leading the field in Distributed File Systems and Object Storage for a reason…Digital transformation is often discussed in terms of processes, services and applications. But what’s really driving it is data: management of it, access to it, and the ability to analyse it and put it to use. And of course, it’s growing at a phenomenal rate – especially when it’s unstructured. According to Gartner, by 2022, more than 80% of enterprise data will be stored in scale-out storage systems in enterprise and cloud data centers, up from 40% in 2018¹.Organizations need to make the most of their data capital, and they need the tools to achieve it. Here at Dell EMC, we’re proud to be among the market leaders. Indeed, for the third year in a row, we have been recognised as a leader in Gartner’s Magic Quadrant for Distributed File Systems and Object Storage (DFOS).In the 2018 report, Gartner highlights both Isilon and ECS as one of the strongest performers in the market, which should come as no surprise, given our strong market leadership over the last years. And now, with the recent launch of the ECS EX-Series this past August, the announcement last year of the Isilon Generation 6 hardware platform, and more to come early next year, that leading position is something on which we’re sure to build.What customers seekYour customers need a flexible solution that allows them to make the most of all the information they hold. With the powerful data analytics functions of Dell EMC Unstructured Solutions, they can unlock that data capital.With Dell EMC Isilon Scale-out Network Attached Storage (NAS), your customers can store, manage and protect unstructured data with efficiency and massive scalability. Dell EMC Isilon is the industry’s #1 family of scale-out network-attached storage systems, and is designed for demanding enterprise file workloads. Your customers can choose from all-flash, hybrid and archive NAS platforms powered by Intel® Xeon® processors.With Dell EMC ECS Object Storage, they can capitalize on their traditional data assets through modernization. With ECS, they can store and manage unstructured data with public cloud-like scalability and flexibility, while retaining complete control over the information they hold, as well as reducing their security and compliance risks.Develop compelling sales arguments with our market-leading position: read Jeff Boudreau’s external blog announcing our position in the Gartner Magic Quadrant. And, you can explore and distribute the full Gartner report to your customers and prospects – link here.last_img read more

How Adobe and Isilon OneFS Deliver Rock Solid Collaboration for Post-Production

first_imgGood collaboration leads to better work. Giving artists the tools to collaborate is one of the ways of making the post-production workflow more manageable and predictable. This has been the Isilon story from the start and is highlighted in Dell’s recent work with Adobe and the new Productions workflow in Adobe® Premiere® Pro.Stories Best Shared Over a Cold BeverageNot all storage solutions for media production are the same and not all media applications address shared storage in the same way. Ask any SysAdmin or Broadcast Engineer for stories about media solutions working together (or not working together) and there are hours of stories to be shared over a cold beverage. Because of the need for interoperability, a big part of what we do is test and gather a lot of field data on solutions our customers are using to make sure everything works together. Understanding which under-the-covers API calls media applications use and how to efficiently leverage network shared storage across macOS and Windows is a nontrivial topic for another blog post. At the core of this, carefully testing and refining a joint solution is why our partnership with Adobe has delivered great results for both Premiere Pro and Isilon users alike.Collaboration Delivering Results Two requirements for any collaborative workflow are software that can enable a seamless experience and a high performance, rock-solid shared storage system. Building on our close partnership, we recently had the opportunity to test the new Productions feature of Premiere on an Isilon storage cluster and Dell Precision workstation in one of the editing suites at the Adobe office in Santa Monica.Once the Isilon cluster was up and running, a regular cadence of communication was established between the Adobe team doing the testing and Dell media solutions architecture. When issues came up, we worked together to figure out what was happening and get the setup right.Concurrently to the Productions testing, Isilon OneFS performance engineering and Premiere software development were also in communication. In fact, this resulted in an engineering visit to the Isilon media lab in Seattle.This, really, is the best sort of collaboration between partners. Both sides have a genuine desire to come together to build a best of breed collaborative experience.Technical WeedsGetting into the technical weeds a little bit, the Isilon cluster in Santa Monica was connected via multiple 40GbE links to a core switch, but Adobe only had 10GbE to their desktops. 10GbE ethernet has a theoretical maximum throughput of 1250MB/s, with real world performance of 1000MB/s being more typical. This is totally fine for compressed codecs but 4K uncompressed image sequences are regularly going to exceed this throughput: 53MB/frame * 30 FPS = 1590MB/s! LACP bonding of ethernet links provides redundancy but no extra throughout.Enter SMB3 multichannel… Windows can aggregate throughput of multiple ethernet links from a workstation to network storage. Of course, the network storage device must support SMB3 multichannel for this to work. It goes without saying that OneFS has supported SMB3 multichannel for years (way back to OneFS 7.1.1). It just works, really, really well.One of the fun things at Adobe was demonstrating this capability on a Dell Precision workstation connected via 2x 10GbE links back to the core switch. Premiere Pro was able to easily play back material that would have exceeded the capability of a single 10GbE link, no new infrastructure required!Ok, back to Productions…Now that Productions in Premiere Pro has been launched, we can confidently say the new feature set function flawlessly on Isilon shared storage. This is true of all the operating systems Premiere Pro supports, Windows, macOS, or a mixture of the two. See the links at the bottom of this blog post for the updated Isilon OneFS and Premiere Pro best practices whitepaper. For most users, no additional configuration on Isilon needs to be performed. If advanced users have changed some of the default file system change notification settings, guidance has been provided.The partnership between Dell and Adobe ensure our mutual customers can have rock solid predictable collaborative workflows. This is just the latest example of why our media team here at Dell values our deep ties with the team at Adobe.To find out more about our Dell Media solutions, webinars and tools visit our M&E resource page.Adobe Premiere Pro and Isilon OneFS Best Practices WhitepaperSMB Best Practices Whitepaper (with more information SMB3 Multichannel)last_img read more