Skip to main content

 


Future is probabilistic

Hi MD,

"All models are wrong, but some are useful".

What did the British statistician George Box mean when he wrote these now-famous words in 1976, and how is it relevant to you?

Whenever we try understanding the world around us - be it our customers' behavior, or how stars circle the center of a galaxy, or how coronavirus affects the human body - we never have direct and full access to the underlying reality. Instead, what we have access to is only the data generated by the process that we want to understand.

So, for example, we know that a customer clicked on one button but ignored the other one. Based on this data point, we now infer what sort of customer she must be and predict her needs are and how we can fulfill them.

Notice that the data hasn't told you a lot - it's sterile, a mere bunch of numbers. But when you combine the fact that a customer clicked on the button with your assumptions about how people behave, you get the magical ability to predict the future (which you can use to your advantage).

But your assumptions are not equal to reality and that's why Box said: "all models are wrong". To understand this clearly, look at the following chart

Chart Visualization of George Box's Famous Words

Imagine you start observing the data from the start (the bottom left) and you move in time and collect more data points (up to the blue circle). At this stage, you have to decide whether future data points will lie on the red curve or the black curve. Perhaps you have to make a business decision based on this choice. Which one will you pick?

Actually, in this case, even though black and red curves are generated through two very different realities (see their equations), there's no way any amount of historical data can help you choose because all data up to blue circle is consistent with both.

As you can see data cannot help you select between hypotheses, it can only help you eliminate. The idea that theories can never be proved true, but only be shown to be wrong is core to how science is done. So scientists definitely know which theories are wrong, but they never know for certain which theories are right. (Surprisingly, that's also how venture capitalists work: while investing, they know for sure which companies are "duds" but they never know which ones are going to be "unicorns").

Box also said: "some (models) are useful". Notice that he didn't say some models are correct. He used the term "useful".

The usefulness of models points to their ability to predict the future. Scientific laws (like Newton's law of gravitation) are models that help us predict solar eclipses hundreds of years ahead. They work quite well for this purpose while another model like throwing darts to predict eclipses will fail horribly. So even though both models are wrong, newton's law gives us more mileage because it's proven to be useful in a variety of contexts.

The key points to remember:
  • Don't shoot for being right because there's no such thing as the "correct" assumptions. Shoot for having "useful" assumptions.
  • Data alone is sterile. Whenever you think data is giving you insights, it's actually the data+your assumptions that are informing you.
If you enjoyed reading my letter, do send me a reply with your thoughts. I read and reply to all emails :)

Cheers
Paras Chopra

PS: This is my 2nd letter to VWO's list. Planning to send such ideas/stories on data and experimentation fortnightly. (These letters are getting  cross-posted on our website too).



VWO (A Wingify product) 14th Floor, KLJ Tower, Netaji Subhash Place Delhi 110034 India
This email was sent to bablu.sahil786.rockmoney@blogger.com. Update your email preferences to choose the types of emails you receive.

Comments

Popular posts from this blog

Youtube to Video Mp3 Mp4 Converter Download

Youtube Link to Video Mp3 Converter Download.  1. Youtube to mp3 Dowloader Converter.  You can download app here,  csc Best downloader app.  Youtube to mp3 converter This fast and easy to use converter allows you,  Download YouTube video mp3 for free wherever you are,  G0. Just one YouL ube link coPy, rewind and get ready to Listen to your mp3 file. So fast and easy! Instruction,  The main thing you need to do before getting ready,  The to-use mp3 has to be copied to a link first. Then go to our site 2conv.com and paste this link Special area in tne. Convert press to mp3. Your MP3 is ready to listen and enjoy! Don't forget to share this amazing ,opportunity Your friend. They will be very grateful to you! Enjoy Music with 2conv - Your Online YOu l ube to mp3 converter,  Are you tired of trying a fast and sociable to mp3, YouTube converter music that will allow you,  Download videos and favorite music tracks? And yours,  Tries to find an easy option to get your file

ria money transfer- Online Money Transfer ria money

Riya Money Transfer is one of the largest money transfer companies in the world. With more than 317,000 locations in 146 countries around the world and an easy-to-use online dashboard, Rhea is convenient for both sender and recipient. Founded in New York in 1987, Rhea began with the simple goal of providing simple and reliable shipping services to people who ship home with an emphasis on friendly service. Over the years, Rhea has grown as a global company, expanding (and continuing to expand) to its worldwide location. In addition to remittance services, Riya Money Transfer offers bill pay, mobile recharge, prepaid debit cards, check cashing, money orders, and more. With a strong presence on almost every continent in the world, Riya is a brand that millions of people trust. Finally, as a company that places great value on the safety of its customers, you know that your money is always in good hands. The good thing about RIA Money Transfer $ 0 transfer fee when you use a bank account to

Health UP

  Healthup Capsule FREE SAMPLE (36 Caps) ONLY FOR TODAY Lorem ipsum dolor sit amet, consectetuer adipiscing elit, sed diam nonummy nibh euismod tincidunt ut laoreet dolore magna aliquam erat volutpat. Ut wisi enim ad minim veniam, quis nostrud exerci tation ullamcorper suscipit lobortis nisl ut aliquip ex ea commodo consequat. Immune tablets buy soon. Today buy.  BUY NOW