Hamburg, a graph computing framework on Hadoop

As mentioned ago, I've been forming up the Hamburg project with Hyunsik Choi. Let's see more detail in the diagram of computing method of Hamburg based on BSP model.




Each worker will process the data fragments stored locally. And then, We can do bulk synchronization using collected communication data. The 'Computation' and 'Bulk synchronization' can be performed iteratively, Data for synchronization can be compressed to reduce network usage.

Plainly, It aims to improve the performance of traverse operations in Graph computing. For example, to explores all the neighboring nodes from the root node using Map/Reduce (FYI, Breadth-First Search (BFS) & MapReduce), We need a lot of iterations to get next vertex per-hop time.

If (same condition as before) do BFS using Hamburg, It will cause a lowering the cost of iterations. Let's assume the graph looks like presented below:




The graph was stored in Hbase on distributed system as above. The root is 1. Then, we need only one 'Bulk synchronization' between server2 and server3 with Hamburg. Rests will be calculated on local machine.




Almost graph algorithms are similar with this case.

Updated - 26 August, 2009 : See also, Inference anatomy of the Google Pregel

113 comments:

  1. Server2 needs to tell Server3 that the vertex 6 distance is 2 so that Server3 can assign distance 3 for vertex 7.

    Since Server2 can only see partial view for vertex 2 neighbors, I think Server2 also has to tell Server1 about the distance of vertex 2 (which is 2). Then Server1 decides the final distance of vertex 2 (which is 1).

    Or the other way around: Server1 already decides the distance of vertex 2 is 1 and needs to tell Server2 about it (since from Server2 point of view, the disntance of vertex 2 is 2).

    Eitherway, Server1 and Server2 has to communicate, isn't it?

    ReplyDelete
  2. The start node assumed as a vertext 1. Hence, Server1's processing will be locally done w/o any communicate. There is one communication between Server2 and Server3.

    ReplyDelete
  3. Nice info regarind graph computing framework on Hadoop my sincere thanks for sharing please continue to share this post
    Hadoop Training in Chennai

    ReplyDelete
  4. The share you really give us excitement. Thanks for your sharing. If you feel tired at work or study try to participate in our games to bring the most exciting feeling. Thank you!
    Python Online Training | Learn Python Online

    ReplyDelete
  5. Thanks for sharing this blog, I am reading your post from the beginning, it was so interesting to read. Visit for
    Web Design Company in Delhi

    ReplyDelete
  6. THANKS FOR INFORMATION

    you can search low-cost website with high-quality website functions.
    Today Join Us
    Call: +91 - 8076909847

    website designing company in india

    levantro
    best interior designer in delhi


    livewebindia
    best website designing company in delhi

    seo company delhi

    Best It Service Provider:

    1. Website Designing And Development.
    2. SEO Services.
    3. Software Development.
    4. Mobile App Development.

    ReplyDelete
  7. Hi,
    Thanks for sharing such a useful information,
    If anyone is looking out for a SEO service in Delhi,NCR then there is only one name which you can trust i;e,Nexcuit.com is one of the best SEO company in Delhi. Be Digitally Visible at the Exact Right time you are Being Searched For! We are the pioneer seo company in Delhi and we implement tactical planning and positioning to make stronger your brand presence worldwide and offer the essential impetus to bring up rankings. Call @ 919910326510 and get more insights concerning their charges, Get best SEO Package from the Best SEO Company in Delhi NCR


    seo services in India
    seo service in Delhi
    seo company in Delhi

    ReplyDelete
  8. This comment has been removed by the author.

    ReplyDelete
  9. Bharat CSP is nothing but a business contributor and technology services provider to different kind of banks. Online Bank CSP Registration, Official Site for apply online CSP. Start Your Business. Mini Bank & Start Earning from 1st Month Low Investment Easy Process..

    Apply CSP
    CSP registration
    CSP provider
    Top CSP Provider in India
    Apply Online For Bank CSP
    Online Money Transfer

    ReplyDelete
  10. Thank you so much for this useful article. Visit OGEN Infosystem for Web Designing and SEO Services in Delhi, India.
    SEO Service in Delhi

    ReplyDelete
  11. Very useful information, thanks for sharing with us

    Corporate Training | Best Corporate Training | RAMSOL

    ReplyDelete
  12. TVH is the best video & film Production houses in Delhi, India. We are Creative, positive and productive and create videos like Documentaries, Corporate films, Explainer videos etc. Moreover, we do Event management, Printing and Designing of all IEC, BCC and SBCC Material for all India regions. Being the best video production company in Delhi NCR, we aim to add creativity in each of our service offerings. If you want to make your company/brand stand out, Choose TVH as your partner communication management agency in Delhi NCR.

    ReplyDelete
  13. Great post! I really enjoyed reading it. Keep sharing such articles. Looking forward to learn more from you.
    Mobile app development company in mumbai

    ReplyDelete

  14. Wow!!! It was really an Informational Article which provide me with much Insightful Information. I would like to first thank the author for such an Insightful Content. If someone here is looking for a Website Designing Company in India, then look no further than Jeewangarg.com as we are the best website designing company in Delhi working in the arena for the last 8 years.
    Best website designing company in India
    website designing company in Delhi NCR
    Google Partner in India

    ReplyDelete
  15. Hi,
    Its a really useful Blog. Using this information with your given guidelines we can reduce usage of data network. This graph computing framework on hadoop is very easy and useful.

    ReplyDelete
  16. This comment has been removed by the author.

    ReplyDelete
  17. Thanks For Sharing the Articles,just Thanks Is not enough for all Keep Updating The Articles looking towards more

    To Learn Python and get a Consequence with Happy Then visit same
    python training in chennai | python training in annanagar | python training in omr | python training in porur | python training in tambaram | python training in velachery

    ReplyDelete
  18. Thank you for the amazing value you are providing through your blog.

    ReplyDelete
  19. Thanks for any other wonderful post. Where else may just anyone get that type of info in such a perfect means of writing? I’ve a presentation next week, and I am on the look for such information.
    java training in chennai

    java training in velachery

    aws training in chennai

    aws training in velachery

    python training in chennai

    python training in velachery

    selenium training in chennai

    selenium training in velachery



    ReplyDelete
  20. Get instant assignment help service in Australia. We are in this service from last ten years and provide best assistance to all our clients. If you are in Australia and pursuing your graduation or post-graduation from over there, then you can get assistance from our experts. We believe in providing best to our clients to maintain a long relationship with our clients. You can expect from us a genuine work with zero plagiarism.
    Online Assignment Help

    ReplyDelete
  21. Pretty! This was an extremely wonderful post. Thanks for providing this information.
    Website: panel chart

    ReplyDelete
  22. this article is very good. It is very so much valuable content. I hope these Commenting lists will help to my website
    Website :- Electric hot water heater service in Nagpur

    ReplyDelete
  23. Great post, I think blog owners should larn a lot from this web blog its very user friendly.
    Visit here :- Seo Packages In Gwalior

    ReplyDelete
  24. Very excellent post!!! Thank you so much for your great content. Keep posting.....

    Python Training Institute in Pune
    Best Python Classes in Pune

    ReplyDelete
  25. Nice post! Thanks for your great content and I obtain a huge of knowledge from your best post...
    Selenium with C# Training
    Selenium with Python Training
    Selenium with Java Training
    Learn Selenium with C# Training

    ReplyDelete
  26. I am sure this paragraph has touched all the internet visitors, its really really fastidious piece of writing on building up new weblog.
    online electronics store in india

    ReplyDelete
  27. Great information, i was searching of this kind of information, thank you very much for sharing with us.

    Website : Craigslist Posting Service for Car Dealers |

    ReplyDelete
  28. This was something I was looking for, really helpful, and great work is done. Thank you so much for sharing such valuable information.

    Wbsite : Car Auction Software |

    ReplyDelete
  29. You rocked in this post; we are also work in the same field. Being one of the most trusted mobile app development company we are looking forward to serving clients with superb IT solutions. Also visit: top mobile app development company

    ReplyDelete
  30. https://www.mytectra.com/

    ReplyDelete
  31. Truly incredible blog found to be very impressive due to which the learners who ever go through it will try to explore themselves with the content to develop the skills to an extreme level. Eventually, thanking the blogger to come up with such an phenomenal content. Hope you arrive with the similar content in future as well.
    schönen muttertag gif

    ReplyDelete
  32. Extraordinary blog! I recently went over your website and have found some interesting content.I am glad I found this amazing website on the web.
    Website

    ReplyDelete
  33. I think that this article is very useful for the audience. It provides useful and quality information which is definitely going to help a lot of people.
    Click Here


    ReplyDelete
  34. Finally, I found good quality and decent post, it is very helpful to me. I am grateful and thankful for all your effort and dedication.
    Best CBSE School In Gorakhpur

    ReplyDelete
  35. I truly appreciate just perusing the entirety of your weblogs. Just needed to educate you that you have individuals like me who value your work. Unquestionably an extraordinary post. Caps off to you! The data that you have given is exceptionally useful.data science training in chennai

    ReplyDelete
  36. This comment has been removed by the author.

    ReplyDelete
  37. If your answer is yes to any one of the above questions, well don’t worry anymore. Because, no matter what kind of security challenge or threat you are facing, we have a bunch of professionals ready to get you out of the way of any harm. Be it your protection, your family’s safety, your bodyguard company
    residence or office security and surveillance, your asset protection, your transportation-related security needs, or even your chauffeur requirements, here’s a team that offers you comprehensive, highly efficient yet affordable solutions.

    ReplyDelete
  38. Good information regarding graph computing framework on Hadoop my sincere. Thanks for sharing please continue to share this post. Kinemaster Gold

    ReplyDelete
  39. I just loved your article on the beginners guide to starting a blog.If somebody take this blog article seriously in their life, he/she can earn his living by doing blogging.

    Slot88
    Poker99
    Mpo303
    Mega Slot888

    ReplyDelete
  40. The share you really give us excitement. Thanks for your sharing. If you feel tired at work or study try to participate in our games to bring the most exciting feeling. Thank you! Kinemaster Gold

    ReplyDelete
  41. It was a great blog with so much information of the beautiful places to visit.
    Pest control provider in Nagpur

    ReplyDelete
  42. This is very useful software for you and me. No errors were found during the check.
    You can use it. I hope you like it.
    Marketing and Advertising Graphics

    ReplyDelete
  43. Every weekend i used to pay a visit this web page, because i want enjoyment, since
    this this site conations actually fastidious funny
    information too. Thankyou for sharing.

    Mpo66
    Mpo33
    Mpo10
    Mpo18
    Mpo81

    ReplyDelete
  44. Everything is very open with a precise explanation of the challenges.
    It was truly informative. Your website is extremely helpful.
    Thanks for sharing!

    Hoki Slot Mobile
    Login Sbobet Mobile
    Bet88 Casino
    Daftar Bet88
    Slot Habanero Login

    ReplyDelete
  45. It was not first article by this author as I always found him as a talented author. John Wayne Jacket

    ReplyDelete
  46. Nice Article..!! Thanks for Sharing with us.
    For hand therapy exercise please visit squegg.

    ReplyDelete
  47. Thank you for sharing so insightful article. Rozana.in has a far-reaching presence across various cities in India.
    Visit for more info local grocery stores

    ReplyDelete
  48. Hello there, You have done a great job. As we all know how much Bill of Sale being used. This document is usually used for sale and purchase between two parties like Buyer & seller.
    Visit here colorado Bill of Sale

    ReplyDelete
  49. I love to recommend you Where can crawl Exciting Products latest Jackets, Coats and Vests Click Here Peter Parker Jacket

    ReplyDelete
  50. WSLOT99 merupakan Situs Slot Online Terpercaya dan Resmi di Indonesia yang menyediakan berbagai permainan game Judi Online Terbaik.
    Promo yang berlaku di WSLOT99 :
    ✅ BONUS NEW MEMBER 50%
    ✅ BONUS DEPOSIT HARIAN 5%
    ✅ BONUS ROLLINGAN 0.5%
    ✅ BONUS CASHBACK 5%
    ✅ BONUS REFFERAL UP TO 1%
    Terima Deposit Via E-Wallet dan Pulsa Telkomsel XL !#!
    agen slot online terpercaya
    slot deposit dana
    slot gacor
    slot deposit pulsa
    situs slot online

    ReplyDelete
  51. This post is so interactive and informative.keep update more information...
    AWS Training in Anna Nagar
    AWS Training in Chennai

    ReplyDelete
  52. It’s in reality a nice and useful piece of info. I’m satisfied that you shared this useful information with us. Please stay us informed like this. Thank you for sharing.

    Jokergaming88
    Slot189
    Joker88
    Jokergaming123
    Megawin777

    ReplyDelete
  53. Great web site. A lot of useful information here. I am sending it to some friends ans additionally sharing in delicious. And naturally, thank you on your sweat!

    Asiabola88
    Idn Slot
    777lucky
    Sbobet88 Slot
    Lucky Slot

    ReplyDelete
  54. Hey friend, it is very well written article, thank you for the valuable and useful information you provide in this post. Keep up the good work! FYI, Pet Care adda
    Credit card processing, wimpy kid books free
    ,Essay About Trip With Family

    ReplyDelete
  55. This post is so interactive and informative.keep update more information...
    hadoop training in tambaram
    Big data training in chennai

    ReplyDelete
  56. Nice Post, Good content
    Web development Company in Hyderabad- Inovies
    Ecommerce Development Company
    Social Media Marketing Company in Hyderabad


    Inovies is the best web development company in Hyderabad providing all types of services in web development, mobile app development, ios app development, ecommerce website development, web design.
    It also provides digital marketing services like SEO, SEM, SMM etc.


    ReplyDelete
  57. The great website and information shared are also very appreciable. Young John Dutton Jacket

    ReplyDelete
  58. Great post. keep sharing such a worthy information.
    Mobile app development courses

    ReplyDelete
  59. You made some clear points there. I looked on the internet for the topic and found most guys will go along with with your site.

    Qq988
    Jagoslot88 Login Mobile
    Daftar Slotwin88
    Daftar Slotwin777
    Mas888 Slot Login

    ReplyDelete
  60. Nice blog post so thanks a lot for sharing this great blog post.. keep more post for sharing.. have a nice day.
    Apply for Super Visa Canada

    ReplyDelete
  61. You're so cool! I dont suppose Ive learn something like this before. So nice to find anyone with some authentic thoughts on this subject. Really thanks for starting this up. this web site is something that’s needed on the net, someone with a little bit originality. Helpful job for bringing something new to the internet!

    Royal 88 Slot
    Slotku88
    Slot303
    396slot
    Slot396

    ReplyDelete
  62. Thank You for Providing Such insightful information. If someone is looking for the Quickbooks Customer Service in US.

    ReplyDelete
  63. This comment has been removed by the author.

    ReplyDelete
  64. I like this topic.This site has lots of advantage.I found many interesting things from this site. It helps me in many ways.Thanks for posting this again.

    Mpo New Slot
    Dutaslot
    Mpo Play
    Mpo81

    ReplyDelete
  65. Best AWS Training provided by Vepsun in Bangalore for the last 12 years. Our Trainer has more than 20+ Years
    of IT Experience in teaching Virtualization and Cloud topics.. we are very delighted to say that Vepsun is
    the Top AWS cloud training Provider in Bangalore. We provide the best atmosphere for our students to learn.
    Our Trainers have great experience and are highly skilled in IT Professionals. AWS is an evolving cloud
    computing platform provided by Amazon with a combination of IT services. It includes a mixture of
    infrastructure as service and packaged software as service offerings and also automation. We have trained
    more than 10000 students in AWS cloud and our trainer Sameer has been awarded as the best Citrix and Cloud
    trainer in india.

    ReplyDelete
  66. Visit Quickbooks Customer Service in US and find out QuickBooks is a software that helps you manage your business and track your income and expenses. It also helps you plan for future transactions, which in turn saves you time, money, and effort.

    ReplyDelete
  67. Great post. keep sharing such a worthy information. Azure Data Factory Training in Hyderabad

    ReplyDelete
  68. This is great content for your readers. Thanks for sharing.
    flute for sale

    ReplyDelete
  69. Vedant Computer is Nagpur's 1st Ecommerce website for Refurbished Laptops, Refurbished Desktops, Providing consumers with an almost new-like experience.
    Visit Here::- [url=https://vedabyte.com/]old laptop[/url]

    ReplyDelete
  70. Vedant Computer is Nagpur's 1st Ecommerce website for Refurbished Laptops, Refurbished Desktops, Providing consumers with an almost new-like experience.
    Visit Here:- refurbished desktop

    ReplyDelete
  71. thanks for valuable information
    nice ariticle

    dellbhoomi training

    ReplyDelete