Keylink Blog
Industry News and Views
At the O’Reilly Strata conference in Santa Clara, California this week, Syncsort announced a milestone contribution in its ongoing commitment to the open source community, with a new feature that strengthens Apache Hadoop’s Big Data integration & ETL capabilities.
The new feature is now committed to Apache Hadoop 2.0.3-alpha and has received broad-based support from leading Hadoop organizations. The key improvement is a new feature that allows external sort implementations within the Hadoop MapReduce framework, helping organizations to accelerate development, build complex ETL flows and MapReduce jobs without coding and seamlessly optimize Hadoop. The patch also simplifies use cases that are currently challenging in MapReduce so they can be implemented faster and more efficiently.
Syncsort will leverage the feature by delivering a pluggable version of its leading high-performance sort solution, DMExpress in Q2 this year, which is currently in beta test with select customers.
Over at the Syncsort blog you’ll find some more background and use cases for this feature.
Also this week, Cloudera announced the release of CDH 4.2 which includes the Syncsort external sort contribution as well as most of the changes from Apache Hadoop 2.0.3-alpha.
SYDNEY - October 16, 2012 - Keylink Technology, a leading data warehouse and business intelligence solutions company serving large enterprises and government departments in Australia and New Zealand has today announced a partnership with Contexti, Asia Pacific’s premier Big Data Analytics consulting, systems integration and training company specialising in Hadoop and NoSQL.
“Contexti have established themselves as the go-to company for Hadoop and NoSQL related integration services in Asia Pacific”
Contexti and Keylink will combine industry leading Apache Hadoop related products and services they respectively represent to transition traditional data warehouses into agile analytics and business intelligence solutions.
“Contexti have established themselves as the go-to company for Hadoop and NoSQL related integration services in Asia Pacific,” said Luke Dougherty, Managing Director of Keylink Technology. “Our customers will benefit from our complimentary products and services.
Contexti is Cloudera’s Authorized Training Delivery and Systems Integration Partner for Australia and Asia, working with CDH4 (Cloudera’s distribution including Apache Hadoop version 4) and Cloudera Enterprise 4.0.
Keylink is Syncsort’s Australian partner, providing the Cloudera Certified Syncsort® DMExpress – data integration software that simplifies and speeds the integration and movement of Big Data between the Hadoop Distributed File System (HDFS) and enterprise systems.
“Keylink have a respectable and established track record in data warehouse and business intelligence solutions, including serving 30 of Australia’s top 100 enterprises,” said Sidney Minassian, Founder & CEO of Contexti. “This partnership will allow us to draw on each other’s strengths, providing our customers with end-to-end solutions.”
About Keylink Technology
Keylink Technology is a leading provider of enterprise software solutions located in Sydney, Australia. We solve data warehouse and business intelligence performance problems. For more information visit Keylink Technology
Follow us:
Twitter: @keylinktech
LinkedIn/company/keylink-technology
About Contexti
Contexti is a premier Big Data Analytics consulting, systems integration and training company serving the Asia Pacific markets. We specialise in Hadoop, NoSQL and related technologies and advanced data science techniques. Our solutions solve enterprise data processing challenges and deliver breakthrough customer, revenue and risk insights. For more information visit Contexti.com
Follow us:
Twitter: @Contexti
LinkedIn/company/contexti-big-data-analytics-solutions
Contact
Dimitri Cachia
Contexti
Tel: +61 2 8006 2535
press@contexti.com
Luke Dougherty
Keylink Technology
Tel: +61 2 9956 8555
press@keylink.net.au
Yellowfin has been on a bit of a tear lately.
They’ve just been named by Information Management magazine in its Forty Vendors We’re Watching: 2012 article. The list was compiled in collaboration with a panel of 12 industry experts and analysts, and represents up and coming vendors who are doing their part to shape the future of information management technology. Jim Ericson, editorial director of Information Management wrote:
Elevating BI usefulness while keeping it simple is where the industry is going, and Yellowfin is gathering a reputation for both with interactive dashboards, easy to navigate interfaces and no coding.
Earlier this year Yellowfin was also recognized as one of two overall leaders in Dresner’s 2012 Wisdom of Crowds Business Intelligence Market Study. This global study ranked 17 of the world’s leading BI vendors across 33 different criteria, including: value, quality and usefulness of product, quality of technical support, integrity and whether existing clients would recommend the vendor and its product to others. From the report:
A member of the ‘Emerging’ market segment, Yellowfin moved into the #1 spot for 2012 (up from #3 in 2011) with increased performance in nearly every category. It exceeded both peer and overall sample averages by a wide margin. Yellowfin is a ‘Top 10’ vendor across all categories.
Read more on the Dresner Wisdom of Crowds study…
Syncsort DMExpress is now certified for Vertica 6, next-generation analytics platform from HP.
Syncsort’s certification of DMExpress for high-performance loading of HP Vertica 6 will make it significantly easier for our mutual customers to harness the power of Big Data to drive growth and competitive advantage.
Chris Selland
Vice President, Marketing
HP Vertica
The Vertica Analytics Platform is a column oriented analytic database, designed to handle large, rapidly growing volumes of data for real-time analytics. With advanced usability and performance features, Vertica offers aggressive data compression, automatic high availability, and scale-out MPP architecture based on industry-standard x86 server grids.
Featuring unmatched performance, efficiency and productivity, DMExpress delivers extensive connectivity that makes it simple to extract and transform data from nearly any source, and rapidly load it into the high-performance, massively scalable HP Vertica Analytics Platform without the need for manual tuning or custom coding. This results in cleaner, more relevant data being available sooner to drive real-time analytics.
Supported by Keylink Technology, the exclusive Australian partner for Syncsort data management solutions, DMExpress is used by leading Australian organizations to help tame their data integration challenges, accelerate time-to-insight and reduce the total cost of ownership in their data warehousing and analytics environments.
Data integration has long been a challenge for business intelligence professionals. Now big data is adding a few wrinkles to the process. Syncsort have sponsored a new eBook from TDWI which asks: what are the problems that these technologies bring, what are our common misconceptions about their interaction, and what best practices can we follow to make big data integration a success?
Andrew Brust for ZDNet covering two exciting new partnership announcements from Syncsort, first with Hortonworks and their new Hadoop distribution:
Another noteworthy thing about this partnership is the engineering behind the integration. Syncsort went well beyond garden-variety Hive driver connectivity; instead, DMExpress integrates tightly with HDFS and Hadoop’s MapReduce Framework. DMExpress can work directly with HDFS files and its highly optimized sort routines can be integrated into MapReduce jobs. The latter capability results from Syncsort’s own open source code that links a pluggable sort infrastructure into the Map and Reduce tasks orchestrated by Hadoop.
And second with Greenplum, and their massively parallel processing (MPP) data warehouse appliance:
This partnership means that Greenplum is a certified data endpoint for DMExpress and that, suddenly Hadoop, MPP and transactional databases are peers in the realm of data movement.
This is going to be big.
Scott Denne reporting for the Wall Street Journal:
Many of its data integration customers had already bought from IBM and Informatica, but those products were initially designed in the early days of client-server architecture–a time when there wasn’t much data, Santoni said, while Syncsort’s products were originally designed for mainframes, where it is essential that companies make the most of all their resources.
Nice background piece on Syncsort for the WSJ Venture Capital Dispatch profiling Big Data start-ups and their investors.
Michael Ybarra reporting for CIO Magazine:
Mike Brown, the CTO at ComScore, knows a bit about managing big data. Every day 12 terabytes of information rushes into his cluster of 80 servers running the open-source software Hadoop, which sorts and analyzes the data for a host of clients who want to know things like which online vendor sold the most e-cards or how fast Facebook is growing in Brazil. “We ingest 32 billion new rows of a data a day,” he says.
Comscore was an early adopter of Hadoop in 2009, and have found DMExpress invaluable in their environment to reduce development times, and significantly boost performance.
