Friday, July 19, 2013

mongoDB : How to speed up MongoDB Map Reduce by 20x

Analytics is becoming an increasingly important topic with MongoDB since it is in use for more and more large critical projects. People are tired of using different software to do analytics (Hadoop being pretty involving), and they typically require a massive transfer of data that can be costly.

MongoDB offers 2 ways to analyze data in-place: Map Reduce and the Aggregation Framework. MR is extremely flexible and easy to take on. It works well with sharding and allows for a very large output. MR was heavily improved in MongoDB v2.4 by the JavaScript engine swap from Spider Monkey to V8. The chief complaint about it is that it is quite slow, especially compared to the Agg Framework (which uses C++). Let’s see if we can squeeze some juice out of it.

Read more here

Leave a Reply

All Tech News IN © 2011 & Main Blogger .