Mobile IoT Authors: Zakia Bouachraoui, Yeshim Deniz, Liz McMillan, Pat Romanski, Elizabeth White

Related Topics: @DXWorldExpo, Mobile IoT, Cloud Security

@DXWorldExpo: Blog Post

A Mature In-Memory Data Fabric By @GridGain | @CloudExpo [#BigData]

The growing demands of Big Data, SaaS, & mobile computing have led to a surge in new apps that access & process data in memory

Why the Fast Data World Needs a Proven and Mature In-Memory Data Fabric

Much of what human beings experience as commonplace today - social networking, online gaming, mobile and wearable computing -- was impossible a decade ago. One thing is certain: we're going to see even more impressive advances in the next few years. However, this will be the result of a fundamental change in computing, as current methods have reached their limit in terms of speed and volume. Traditional disk-based storage infrastructure is far too slow to meet today's data demands for speed at volume, which are growing exponentially. In-memory computing (IMC) offers the only practical way to scale to today's computing demands. Although IMC may once have been the domain of only the most well-funded organizations, the falling cost of RAM means that it can now be accomplished by any organization on commodity hardware.

As Mike Matchett, Senior Analyst, The Taneja Group said: "Clearly the big data ecosystem is evolving, tackling more kinds of analytics and addressing a wider variety of applications, including enterprise operational intelligence (EOI) apps that require faster interactive latencies, predictive machine learning, split-second decision-making, and high-volume processing. In-memory computing is key to profiting from new competitively differentiating big data solutions like these."

Spinning disks will certainly be around for years to come, but the growing demands of Big Data, SaaS, mobile computing and Internet scale, coupled with dramatic improvements in RAM economics and availability, have led to a surge in new applications that access and process data in memory. As a result, IMC is quickly moving from esoteric concept to mainstream adoption. Like any game-changing technology, developers need to be able to learn it, experiment with it and test its limits in order to fulfill its promise.

As you may know, GridGain has been at the cutting edge of developing a comprehensive in-memory data processing framework for real-time transactional and analytical use cases for many years. Hundreds of organizations around the globe now use its proven open source technology under the Apache 2.0 license. This work has culminated in the recent release of its application- and data-agnostic GridGain In-Memory Data Fabric. GridGain's in-memory data fabric code base shares the goals of easy accessibility and free redistribution with other memory-centric, open source data exchange frameworks that have emerged -- most notably the Apache Spark project in the Hadoop world.

Today we are thrilled to announce that the GridGain In-Memory Data Fabric has been accepted into the Apache Incubator program under the name "Apache Ignite." Our decision to contribute our pride and joy to the Apache Software Foundation (ASF) will ensure that this robust and battle-tested software not only remains broadly available, but will continue gaining community support to become the standard upon which in-memory computing's promise will be realized. While GridGain will continue to be a strong contributor to the Ignite code base and offer new and innovative enterprise-grade features to its commercial product, the platform's core code will be managed by the non-profit ASF, home of the world's most successful open source projects.

Mike Matchett, The Taneja Group, continues: "GridGain has now put their key IP out for the world to use as Apache Ignite. We predict an enthusiastic adoption curve since GridGain's approach leverages current developer skills and accelerates existing Hadoop apps without modification, providing an easy transition into in-memory computing."

In order to explain why now is the right time to trust our code base to the ASF, it is first necessary to explain why we went to an open source model less than a year ago--and for that matter, why we spent years developing this software in the first place.

Earlier this year, we took an important step in order to make the transformation to IMC truly accessible by shifting to an open source model through an Apache 2.0 license. Our motivation was simple: remove all barriers to IMC adoption and accelerate the innovation that's poised to occur through this technology. We wanted to introduce IMC to the mass market in a way that would give developers maximum freedom to experiment with it and discover the amazing things it allows you to  do - for example, accelerating drug discovery for diseases such as cancer. The first step was to make our mature and tested IMC platform open source, so that the technology would be as widely available and easily adoptable as possible. So we put the IMC code up on places like GitHub, which resulted in a more than 2000 percent increase in downloads in just a few months, clearly validating the huge interest from the community in the software.

The second step -- turning over the keys to the Apache Software Foundation -- will drive true community-building beyond just open source consumption, and of course will ensure the in-memory data fabric's viability for the long term. By doing this, we hope to continue to fast-track both the adoption and adaptation of this technology.

Ilya Sterin, Sr. Director of Engineering, Chronotrack Systems, summed up the advantages of this strategy: "GridGain's In-Memory Data Fabric enables us to solve our data and compute scale challenges, which become increasingly complex as our systems grow to support more events and athletes. With its track record behind open source projects, the Apache Software Foundation's backing of GridGain's open source platform gives us confidence that we can rely on it for the long term, and that we can expect to see ongoing innovation as this project is opened to thousands of contributors."

Ultimately, community-driven adoption of open source in-memory data fabric technology will enable a new class of transactional, analytical and hybrid real-time applications that will allow even the smallest organizations to gain a competitive advantage from fast, data-driven decisions and operations. We believe Apache Ignite has all the right ingredients to become for the Fast Data world of the future what Hadoop is for Big Data today.

Let the innovation begin!

More Stories By Nikita Ivanov

Nikita Ivanov is founder and CEO of GridGain Systems, started in 2007 and funded by RTP Ventures and Almaz Capital. Nikita has led GridGain to develop advanced and distributed in-memory data processing technologies – the top Java in-memory computing platform starting every 10 seconds around the world today.

Nikita has over 20 years of experience in software application development, building HPC and middleware platforms, contributing to the efforts of other startups and notable companies including Adaptec, Visa and BEA Systems. Nikita was one of the pioneers in using Java technology for server side middleware development while working for one of Europe’s largest system integrators in 1996.

He is an active member of Java middleware community, contributor to the Java specification, and holds a Master’s degree in Electro Mechanics from Baltic State Technical University, Saint Petersburg, Russia.

IoT & Smart Cities Stories
Early Bird Registration Discount Expires on August 31, 2018 Conference Registration Link ▸ HERE. Pick from all 200 sessions in all 10 tracks, plus 22 Keynotes & General Sessions! Lunch is served two days. EXPIRES AUGUST 31, 2018. Ticket prices: ($1,295-Aug 31) ($1,495-Oct 31) ($1,995-Nov 12) ($2,500-Walk-in)
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next...
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
All in Mobile is a place where we continually maximize their impact by fostering understanding, empathy, insights, creativity and joy. They believe that a truly useful and desirable mobile app doesn't need the brightest idea or the most advanced technology. A great product begins with understanding people. It's easy to think that customers will love your app, but can you justify it? They make sure your final app is something that users truly want and need. The only way to do this is by ...
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed...