Gemini Releases Real-Time Log Processing Based on Flume and Cassandra
Poster: SySAdmin
Posted on March 3, 2011 at 6:07:01 AM
Gemini Releases Real-Time Log Processing Based on Flume and Cassandra
FOSTER CITY, Calif., March 3, 2011 /PRNewswire/ -- Gemini Mobile Technologies ("Gemini") released a Real-Time Log Processing System based on Flume and Cassandra ("Flume-Cassandra Log Processor") as open source today. The Flume-Cassandra Log Processor enables massive volumes of production system logs to be collected and processed into graphical reports, in real-time. In addition, logs from multiple data centers can be simultaneously aggregated and analyzed in a single database. With its ability for real-time analysis at unprecedented volumes, Gemini's Flume-Cassandra Log Processor enables businesses to vastly improve both the quality and timeliness of business intelligence gained from their online operations. This dramatic scalability at low cost and small footprint is enabled by NOSQL (Not Only SQL) technology, which originates from Cloud Storage technologies at Google, Facebook, and Amazon.
Logs record online activities of users and applications, in real-time. Web service providers, telecom carriers, eCommerce providers, and corporate websites analyze logs to improve customer experience and their business operations. Traditional systems process logs offline because log files are too big for relational databases, typically producing reports days to weeks after the time when logs were generated. Gemini's solution uses Flume to stream log entries as they occur, data is extracted on the fly and inserted in real-time into a Cassandra NOSQL database. This allows reports to be updated in real-time, less than a second after the log event. Offline analysis is also supported by querying the Cassandra database and running MapReduce jobs. The Flume-Cassandra Log Processor can be easily scaled from a few PCs to multiple clusters, allowing hundreds of Terabytes of logs to be stored, analyzed, and automatically deleted upon expiration.
"Business intelligence is the key ingredient for enterprises and service providers to provide a personal and effective web experience to their customers," said Michael Tso, co-founder and COO of Gemini. "Our Flume-Cassandra Log Processor delivers business intelligence in real-time, at data volumes and velocities that were previously unattainable. We are pleased to release it as open source, allowing easy customization and improvement by the community."
"Gemini's real-time log processing solution is an impressive demonstration of Cassandra's capabilities for solving big data problems in real-time," said Matt Pfeil, CEO of DataStax, the commercial leader in Apache Cassandra. "Cassandra is quickly gaining momentum as the scalable platform for web and enterprise applications. We look forward to continuing our innovation and collaboration with Gemini."
The Flume-Cassandra Log Processor can be downloaded from Github: https://github.com/geminitech/logprocessing
About Gemini
Gemini is a leading provider of high-performance, cloud-enabled messaging platforms. Gemini is a pioneer in real-time Big Data and NOSQL database technology, developing the Hibari® Key Value Store, Hibari Gigabyte-Maildir Email Store, and the Cloudian(TM) Multi-Tenant Cloud Storage System. Gemini has offices in San Francisco, Tokyo and Beijing. Gemini's customers include NTT DOCOMO, Softbank Mobile, Vodafone, and Nextel International; the company also has OEM partnerships with Alcatel-Lucent and Bytemobile. Gemini is backed by Goldman Sachs, Mitsubishi-UFG Capital, Nomura Securities, Mizuho Capital, Access, and Aplix. For more information, visit http://www.geminimobile.com/.
Hibari® is a registered trademark of Gemini Mobile Technologies, K.K.
About Flume and Cassandra: visit: https://github.com/cloudera/flume and http://cassandra.apache.org/
CONTACT: Giorgio Propersi, +1-805-312-6379, gpropersi@geminimobile.com
SOURCE Gemini Mobile Technologies
Gemini Mobile Technologies
CONTACT: Giorgio Propersi of Gemini Mobile Technologies, +1-805-312-6379, gpropersi@geminimobile.com
Web Site: http://www.geminimobile.com/
FOSTER CITY, Calif., March 3, 2011 /PRNewswire/ -- Gemini Mobile Technologies ("Gemini") released a Real-Time Log Processing System based on Flume and Cassandra ("Flume-Cassandra Log Processor") as open source today. The Flume-Cassandra Log Processor enables massive volumes of production system logs to be collected and processed into graphical reports, in real-time. In addition, logs from multiple data centers can be simultaneously aggregated and analyzed in a single database. With its ability for real-time analysis at unprecedented volumes, Gemini's Flume-Cassandra Log Processor enables businesses to vastly improve both the quality and timeliness of business intelligence gained from their online operations. This dramatic scalability at low cost and small footprint is enabled by NOSQL (Not Only SQL) technology, which originates from Cloud Storage technologies at Google, Facebook, and Amazon.
Logs record online activities of users and applications, in real-time. Web service providers, telecom carriers, eCommerce providers, and corporate websites analyze logs to improve customer experience and their business operations. Traditional systems process logs offline because log files are too big for relational databases, typically producing reports days to weeks after the time when logs were generated. Gemini's solution uses Flume to stream log entries as they occur, data is extracted on the fly and inserted in real-time into a Cassandra NOSQL database. This allows reports to be updated in real-time, less than a second after the log event. Offline analysis is also supported by querying the Cassandra database and running MapReduce jobs. The Flume-Cassandra Log Processor can be easily scaled from a few PCs to multiple clusters, allowing hundreds of Terabytes of logs to be stored, analyzed, and automatically deleted upon expiration.
"Business intelligence is the key ingredient for enterprises and service providers to provide a personal and effective web experience to their customers," said Michael Tso, co-founder and COO of Gemini. "Our Flume-Cassandra Log Processor delivers business intelligence in real-time, at data volumes and velocities that were previously unattainable. We are pleased to release it as open source, allowing easy customization and improvement by the community."
"Gemini's real-time log processing solution is an impressive demonstration of Cassandra's capabilities for solving big data problems in real-time," said Matt Pfeil, CEO of DataStax, the commercial leader in Apache Cassandra. "Cassandra is quickly gaining momentum as the scalable platform for web and enterprise applications. We look forward to continuing our innovation and collaboration with Gemini."
The Flume-Cassandra Log Processor can be downloaded from Github: https://github.com/geminitech/logprocessing
About Gemini
Gemini is a leading provider of high-performance, cloud-enabled messaging platforms. Gemini is a pioneer in real-time Big Data and NOSQL database technology, developing the Hibari® Key Value Store, Hibari Gigabyte-Maildir Email Store, and the Cloudian(TM) Multi-Tenant Cloud Storage System. Gemini has offices in San Francisco, Tokyo and Beijing. Gemini's customers include NTT DOCOMO, Softbank Mobile, Vodafone, and Nextel International; the company also has OEM partnerships with Alcatel-Lucent and Bytemobile. Gemini is backed by Goldman Sachs, Mitsubishi-UFG Capital, Nomura Securities, Mizuho Capital, Access, and Aplix. For more information, visit http://www.geminimobile.com/.
Hibari® is a registered trademark of Gemini Mobile Technologies, K.K.
About Flume and Cassandra: visit: https://github.com/cloudera/flume and http://cassandra.apache.org/
CONTACT: Giorgio Propersi, +1-805-312-6379, gpropersi@geminimobile.com
SOURCE Gemini Mobile Technologies
Gemini Mobile Technologies
CONTACT: Giorgio Propersi of Gemini Mobile Technologies, +1-805-312-6379, gpropersi@geminimobile.com
Web Site: http://www.geminimobile.com/