• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

Event Streams question: Use of Amazon Kinesis vs Kafka

 
Greenhorn
Posts: 25
Scala Spring Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hello,

I spent some time and looked through the chapters (in Contents section and those available in abridged form).
I noticed you start from Kafka event stream processing and then proceed with Amazon Kinesis event stream processing.

Question: is Kinesis better platform than Kafka?

I guess the probable answer is - Kinesis is one of the AWS services and thus can easily
use the rich functionality of AWS as a whole, smooth, with no or minor integration efforts, such as:
- Amazon Redshift (used in Ch 10, Analytics-on-read)
- AWS Lambda and Dynamo DB for building Lambda functions  (Ch 11, Analytics-on-write)

Just trying to better understand a place / role for Kafka.

Thank you.
 
Author & Gold Digger
Posts: 7617
6
IntelliJ IDE Java
  • Likes 1
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Yury Nebieridze wrote:Question: is Kinesis better platform than Kafka?



The quick answer is: neither one is better, each has its pros and cons. For instance, one of the biggest difference is that Kafka provides eternal retention, while Kinesis (only) at most one week.

Kinesis is better connected to all the other AWS services, even though it is now possible to easily spin up a Kafka cluster in AWS using AWS Managed Streaming for Kafka instead of having to install a vanilla Kafka on EC2 all by yourself.

You can find plenty of good comparisons between both technologies, for instance http://cloudurable.com/blog/kinesis-vs-kafka/index.html
 
reply
    Bookmark Topic Watch Topic
  • New Topic