• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

Experimentation For Engineers

 
Ranch Hand
Posts: 572
2
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi,
I was intrigued by the description on Amazon of :

Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries.



What is the differentiation between practical experiments and testing or creating a test plan?
If there is a difference when would you use one  over the other?

thanks,
Paul
 
Author
Posts: 6
5
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
The book discusses the design of experiments, like A/B tests or response surface methodology, in idealized conditions: ex., measurements are independent, there is one clear business metric, and good quality randomization possible

Later, it looks into the kinds of non-ideal situations that present themselves in practice: measurements are correlated, you having competing metrics, truly random samples are not trivial, and more.

Also, the book discusses ways to manage the risks of running experiments. If you're trying something new, you might make a mess, so you should take care to limit that For example, you could start each experiment in small size, then scale up as you gain confidence that risks are low.

Dave
 
paul nisset
Ranch Hand
Posts: 572
2
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Sounds interesting.
Thank you Dave.
 
Be reasonable. You can't destroy everything. Where would you sit? How would you read a tiny ad?
a bit of art, as a gift, the permaculture playing cards
https://gardener-gift.com
reply
    Bookmark Topic Watch Topic
  • New Topic