• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

Any kind of example about Microservices, AWS, Kubernetes, Kafka

 
Greenhorn
Posts: 6
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hello everyone.

I have been working with java EE for more than 10 years.
It so happend that I have not had experience with the following technologies: Microservices, AWS, Kubernetes, Kafka.
That's why I am here. I am looking for a challenge using Microservices, AWS, Kubernetes, Kafka.

Can someone advise me any kind of example in order to implement and better understand above technologies.
I have read plenty information about that. I can imagine how it works, but unfortunetly I can not come up with example to try it out in action.
I mean example not about 'hello world' but something is more comprehensive and challenging.
That what I can deploy on AWS and play with perfomance.

I am also considering taking part in any project with the above technologies.

Thanks in advance.
 
Saloon Keeper
Posts: 27763
196
Android Eclipse IDE Tomcat Server Redhat Java Linux
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
One of the best ways to learn AWS is to actually use it. You can spin up small-scale projects on AWS for free and play with the dashboard app.

Kubernetes is even easier, since you can simply download and install MiniKube, which will bootstrap itself into a complete local Kubernetes environment, including a test VM.

Actually, the biggest challenge with AWS is that there's simply so much of it. You can create your own virtual machines and run them in their own private network. You can spin up Elastic Beanstalk services, where you don't even have a full VM of your own, just the service that you require (for example a Tomcat server). You can use their cloud storage and they even provide ready-made relational database servers.

Several years ago, I was subscribed to a service that would email me job leads in batches once or more a day. I was interested specifically in doing remote work, but too many of the postings actually carried the statement "No remote work allowed" or something similar, and the dumb email sender was simply scanning for keywords, not context, so I got a lot of trash.

In my case, I spun up a copy of Apache Karaf and coded a micro-service in OSGi. This service received mail from that sender and scanned each posting. It deleted the unwanted postings and then passed on the rest to my inbox. Kafka could probably do this, too, but I don't think is was available back then.

Since hurricanes are a concern around here, I also coded another micro-service that would poll the National Hurricane Center for information and format that as email sent to my inbox. The NHC does have its own feeds and bulletins, but I wanted something more personalized.

The Karaf server was in turn embedded within a Docker Container, so it could be administered with Kubernetes.
 
Sergey Kolesnikov
Greenhorn
Posts: 6
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

You can spin up small-scale projects on AWS for free and play with the dashboard app


my issue is how to come up with a small-scale project, but I liked your idea about email. Let's break down it in more detail, if you do not mind.

Actually I had the same issue about searching part-time job. But I did not guess that it can be done using microservices.
What engine did you use for searching posts about jobs? Did you use a specific list of websites?
And How to analize all content of posts. I mean you was searching by key words or used some kind of engine for such search?
So there are two microservices, one is getting posts from internet and send it to another service which processes it and send to your email?
What way did you use for communication between two services? It was some kind of message queue or just a http request?

The main question, It helped you to find additional part-time job?

Thanks for you help!
 
Tim Holloway
Saloon Keeper
Posts: 27763
196
Android Eclipse IDE Tomcat Server Redhat Java Linux
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I was looking at one specific job site and they had the option to mail me jobs of interest. Among the "magic words" it was supposed to look for were "telecommute" and "remote".

However, their engine was too stupid to eliminate stuff where such words were indicated in a negative context. So this is what I did:

1. Set up the job board's mailer to send me "interesting" jobs.

2. Set up my email client to route those emails to a special email folder using procmail

3. The OSGi service in Karaf would then scan that folder periodically using IMAP. When it detected new emails, it would retrieve them, filter out the inappropriate messages and then send the results to my primary inbox. The original email would then be deleted in order to keep the staging folder from filling up.

So this is basically just leveraging common OS services with a microservice using JavaMail.
 
Sergey Kolesnikov
Greenhorn
Posts: 6
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Your example fits to my goals well.
I really appreciate your answer.
Thanks for idea.
 
First, you drop a couch from the plane, THEN you surf it. Here, take this tiny ad with you:
a bit of art, as a gift, the permaculture playing cards
https://gardener-gift.com
reply
    Bookmark Topic Watch Topic
  • New Topic