22 Jul '14, 3pm

Shopify's Kafka Producer Pipeline for Ruby on Rails

Shopify's Kafka Producer Pipeline for Ruby on Rails

In the early fall our infrastructure team was considering Kafka , a highly available message bus. We were looking to solve several infrastructure problems that had come up around that time. We were looking for a reliable way to collect event data and send it to our data warehouse. We were considering a more service-oriented architecture, and needed a standardized way of message passing between the components. We were starting to evaluate containerization of Shopify, and were searching for a way to get logs out of containers. We were intrigued by Kafka due to its highly available design. However, Kafka runs on the JVM, and its primary user, LinkedIn, runs a full JVM stack. Shopify is mainly Ruby on Rails and Go, so we had to figure out how to integrate Kafka into our infrastructure. Avoiding a direct link between Ruby and Kafka The straight forward solution is to emit event...

Full article: http://www.shopify.com/technology/14909841-kafka-producer...

Tweets

Aprende Ruby on Rails: Introducción a Ruby on R...

twitter.com 25 Jul '14, 2am

To bring you Twitter, we and our partners use cookies on our and other websites. Cookies help personalize Twitter content,...

Aprende Ruby on Rails: Introducción a Ruby on R...

twitter.com 25 Jul '14, 6am

To bring you Twitter, we and our partners use cookies on our and other websites. Cookies help personalize Twitter content,...

Ruby On Rails Service Container [Score:4]

stackoverflow.com 25 Jul '14, 12am

I think it's important to not mix up Ruby (the language) and Ruby on Rails (the framework) - I'm not saying that you're do...

Scaling Ruby on Rails: How it can done, and how...

ht.ly 28 Jul '14, 2pm

Tweet Share Top Tweets Rating: (+1 )

A great intro to #rubyonrails for anyone keen t...

railsapps.github.io 23 Jul '14, 2pm

Rails is popular and widely used because its conventions are pervasive and astute. Any web application has complex require...

#unilo built with Ruby on Rails and is here #YR...

unilo.herokuapp.com 03 Aug '14, 12pm

Where will you go? Find you perfect university.

#RubyOnRails Build a Simple Ruby on Rails Websi...

freelancer.com 26 Jul '14, 3pm

Project Description: The full design / UI is complete. The site will use the Embed.ly gem, and overall has a minimal featu...

He creado el grupo Ruby on Rails latino en Link...

linkedin.com 27 Jul '14, 12am

If you are not automatically redirected, please

Shopify Singapore Global Digital Marketplace

Shopify Singapore Global Digital Marketplace

ecommerce.shopify.com 24 Jul '14, 9pm

ch 01 Ecommerce Legal Guide: Singapore Whether you're starting a brand new business or you're an established retailer, tak...

Happy 10th Birthday, Ruby on Rails! @rails @rub...

github.com 25 Jul '14, 5pm

The first public release was 0.5.0: http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-talk/107370 on July 24. So that...

New Job: Full Stack Engineers | Java and/or Rub...

tra.timesheetlive.com.au 28 Jul '14, 12am

A company that is so technology driven and harbouring a strong team who excel in a number of technical skills across Java;...

Want to work with an awesome development team @...

blog.inspire9dev.com 25 Jul '14, 5am

Looking to work in a small, agile team on projects that make a difference? Want to leave behind legacy code and work on fr...

Create an Azure Virtual Machine:

azure.microsoft.com 25 Jul '14, 3pm

From the command-line or terminal session, create a new Rails application named "blog_app" by using the following command:...

A Series of Screencasts and Guides for Ruby on Rails

A Series of Screencasts and Guides for Ruby on ...

webappers.com 22 Jul '14, 7am

A Series of Screencasts and Guides for Ruby on Rails Posted · Category: Information , License Free GoRails is Ruby on Rail...