Skip to main content

No, that won't work

Hi MD,

Last week I interviewed Ian Harris, a professor of surgery, for my podcast. His research has found that over half of all surgeries are ineffective.

Yes, you heard that right: the majority of surgeries don't work (as compared to a placebo). The list of what doesn't work includes commonly done surgeries such as those done for knee pain, back pain, hip replacement, and so on. (If you don't believe me, I highly recommend watching this talk by the professor.)

Surgery: the Ultimate   Placebo


This claim indeed sounds shocking, but recall that the most common surgical procedure in human history was bloodletting. In this practice that lasted for thousands of years and was common until the 1850s, the doctor would make a cut in the body and simply let out the blood of the patient.

Everyone thought this should work (partly because everyone did it) and many different variations of bloodletting were iterated and compared with each other. But, amazingly, a question that wasn't asked until the 19th century was whether performing bloodletting works better than not doing it at all? Once this question was asked and a randomized control study was done, it was quickly understood that bloodletting doesn't work (but may actually actively harm the patient).

Let me reiterate… bloodletting was performed for over 2000 years before it was discovered that it doesn't work.

This makes you wonder - what else that we do commonly doesn't actually work?

Actually, the sad part is that we don't know what doesn't work because, apart from medicine and science, we don't perform enough randomized control trials (which are nothing but A/B tests in the marketing parlance). Even in the field of surgery, a systematic review of ~10,000 surgical procedures discovered that an A/B test was conducted for only 1% of such procedures. The remaining 99% of procedures were simply assumed to work.

In our day to day work as marketers, product managers, or leaders, we take so many decisions that feel right. Surely, that "best practice" change should work. Or this new campaign makes sense, so it should be run. But does it really work? What evidence do you have that if you hadn't done anything, that metric wouldn't have gone up?

Like the human body, businesses and markets are complex systems. There are thousands of factors that influence whether a particular action will have the desired impact. If the suggested action is our idea, we're biased to believe that it works.

However, learning from the ineffectiveness of bloodletting and many such surgeries that are still performed, the right attitude should be that best practices and genius ideas may simply not work (or, worse, may actively harm).

Unless a properly set up randomized control trial (or an A/B test) gives clear evidence of harm or benefit of a particular action, it would pay to believe that it probably doesn't have any impact. The default orientation towards a new idea should be: no, it doesn't work (unless you can prove that it works).

In other words, yes you should really be planning to run 25,000 A/B tests in 2021.

Do you have a story of an A/B test that debunked a widely held belief? I'd love to know about it. I read and reply to all emails :)

Regards,
Paras Chopra
Founder and Chairman, VWO

@paraschopra on Twitter

PS: These letters are getting cross-posted on our website too. Read my past letters here.



VWO (A Wingify product) 1104, 11th Floor, KLJ Tower North B-5, Netaji Subhash Place, Pitampura, Delhi – 110034, India
This email was sent to bablu.sahil786.rockmoney@blogger.com. Update your email preferences to choose the types of emails you receive.

Comments

Popular posts from this blog

ria money transfer- Online Money Transfer ria money

Riya Money Transfer is one of the largest money transfer companies in the world. With more than 317,000 locations in 146 countries around the world and an easy-to-use online dashboard, Rhea is convenient for both sender and recipient. Founded in New York in 1987, Rhea began with the simple goal of providing simple and reliable shipping services to people who ship home with an emphasis on friendly service. Over the years, Rhea has grown as a global company, expanding (and continuing to expand) to its worldwide location. In addition to remittance services, Riya Money Transfer offers bill pay, mobile recharge, prepaid debit cards, check cashing, money orders, and more. With a strong presence on almost every continent in the world, Riya is a brand that millions of people trust. Finally, as a company that places great value on the safety of its customers, you know that your money is always in good hands. The good thing about RIA Money Transfer $ 0 transfer fee when you use a bank account to

Youtube to Video Mp3 Mp4 Converter Download

Youtube Link to Video Mp3 Converter Download.  1. Youtube to mp3 Dowloader Converter.  You can download app here,  csc Best downloader app.  Youtube to mp3 converter This fast and easy to use converter allows you,  Download YouTube video mp3 for free wherever you are,  G0. Just one YouL ube link coPy, rewind and get ready to Listen to your mp3 file. So fast and easy! Instruction,  The main thing you need to do before getting ready,  The to-use mp3 has to be copied to a link first. Then go to our site 2conv.com and paste this link Special area in tne. Convert press to mp3. Your MP3 is ready to listen and enjoy! Don't forget to share this amazing ,opportunity Your friend. They will be very grateful to you! Enjoy Music with 2conv - Your Online YOu l ube to mp3 converter,  Are you tired of trying a fast and sociable to mp3, YouTube converter music that will allow you,  Download videos and favorite music tracks? And yours,  Tries to find an easy option to get your files,  Tre

SBI Clerk Exam Results

  SBI Clerk Results 2021 Out, Clerk prelims Marks out.  Table of Contents SBI Clerk Score Card 2021 Out SBI Clerk Prelims Score Card 2021 SBI Clerk Score Card & Marks 2021 SBI Clerk Score Card 2021 Out SBI Clerk Prelims Score Card 2021: State Bank of India has released the SBI Clerk Prelims Score Card 2021 along with the release of SBI Clerk Prelims Result on 21st September 2021. The candidates who have appeared in the prelims exam on 10th, 11th, 12th, 13th July and 29th August 2021 can check their SBI Clerk Score Card from the official website of SBI @sbi.co.in or directly from the below link mentioned in the article. SBI Clerk Prelims Score Card 2021 SBI Clerk Prelims Score Card 2021 Organisation     State Bank of India Exam Name     SBI Clerk 2021 Post Name     Junior Associates (Clerical Cadre) Vacancies     5454 SBI Clerk Exam Date     10th, 11th, 12th, 13th July and 29th August 2021 SBI Clerk Prelims Score Card     21st September 2021 SBI Clerk Prelims Result     21