• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Ron McLeod
  • Paul Clapham
  • Devaka Cooray
  • Tim Cooke
Sheriffs:
  • Rob Spoor
  • Liutauras Vilda
  • paul wheaton
Saloon Keepers:
  • Tim Holloway
  • Tim Moores
  • Mikalai Zaikin
  • Carey Brown
  • Piet Souris
Bartenders:
  • Stephan van Hulst

Event Streams question: Use of Amazon Kinesis vs Kafka

 
Greenhorn
Posts: 25
Scala Spring Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hello,

I spent some time and looked through the chapters (in Contents section and those available in abridged form).
I noticed you start from Kafka event stream processing and then proceed with Amazon Kinesis event stream processing.

Question: is Kinesis better platform than Kafka?

I guess the probable answer is - Kinesis is one of the AWS services and thus can easily
use the rich functionality of AWS as a whole, smooth, with no or minor integration efforts, such as:
- Amazon Redshift (used in Ch 10, Analytics-on-read)
- AWS Lambda and Dynamo DB for building Lambda functions  (Ch 11, Analytics-on-write)

Just trying to better understand a place / role for Kafka.

Thank you.
 
Author & Gold Digger
Posts: 7617
6
IntelliJ IDE Java
  • Likes 1
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Yury Nebieridze wrote:Question: is Kinesis better platform than Kafka?



The quick answer is: neither one is better, each has its pros and cons. For instance, one of the biggest difference is that Kafka provides eternal retention, while Kinesis (only) at most one week.

Kinesis is better connected to all the other AWS services, even though it is now possible to easily spin up a Kafka cluster in AWS using AWS Managed Streaming for Kafka instead of having to install a vanilla Kafka on EC2 all by yourself.

You can find plenty of good comparisons between both technologies, for instance http://cloudurable.com/blog/kinesis-vs-kafka/index.html
 
There are 29 Knuts in one Sickle, and 17 Sickles make up a Galleon. 42 tiny ads in a knut:
Gift giving made easy with the permaculture playing cards
https://coderanch.com/t/777758/Gift-giving-easy-permaculture-playing
reply
    Bookmark Topic Watch Topic
  • New Topic