Win a copy of Head First Android this week in the Android forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
  • Campbell Ritchie
  • Paul Clapham
  • Ron McLeod
  • Tim Cooke
  • Junilu Lacar
  • Rob Spoor
  • Devaka Cooray
  • Jeanne Boyarsky
Saloon Keepers:
  • Jesse Silverman
  • Stephan van Hulst
  • Tim Moores
  • Carey Brown
  • Tim Holloway
  • Jj Roberts
  • Al Hobbs
  • Piet Souris

Serverless Machine Learning in Action: Costs

Posts: 29
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Good day,

If you are a small company, should serverless ML be avoided due to costs that it might incur? How should you approach serverless ML if you have limited resources?

Posts: 8
  • Likes 1
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi Jose,

Thank you for your question. In general, if you are cost-constrained, then cloud is a double edged sword. For a small business it might be more simple to take care of a well known fixed capital expense upfront (for example buy a few servers) than to subscribe to a cloud service where the total cost of the IT resources is less clear upfront. I find that many small businesses have figured out how to limit their cloud service subscription expenses or how to take advantage of the numerous credits or promotions from major cloud providers (AWS, Azure, GCP) so that subscription cost is less of an issue.

With that said, the point of serverless ML is to reduce OPERATIONAL costs. In other words, if you are a small business and you don't have the money to hire administrators or SREs to babysit your machine learning system in production, then serverless ML is the right approach for you. With serverless ML, you design your ML system so that in production you have little to no need for operations personnel. Hence, you can take your ML expertise, apply it to the serverless ML design, get to the market sooner, and scale up or down to keep the operational costs in-line with the demand for your ML system.
    Bookmark Topic Watch Topic
  • New Topic