Daniel_Barth-Jones Photo

Can You Be Identified from Anonymous Data? It’s Not So Simple

For the past several years, a highly technical but very important debate has raged among privacy experts: How easy is it to identify an individual from a collection of data that supposedly lacks personally identifiable information? Those who say that it is relatively easy argue for greater restrictions on the release of data and more stringent efforts to anonymize it. Their opponents argue that worrying too much about the risk of “re-identification” deprives researchers of valuable data in fields such as epidemiology.

Daniel_Barth-Jones Photo
Daniel Barth-Jones (Columbia Univ.)

A centerpiece of the debate is a 1997 incident in which Latanya Sweeney, then an MIT graduate student and now a computer scientist at Harvard, identified the medical records of Massachusetts Governor William Weld from information publicly available in a state insurance database. The incident led to important changes in privacy rules for medical information, especially under the Health Insurance Portability and Accessibility Act (HIPAA), and 15 years later it is still influencing the debate over data privacy.

But a new draft paper by Daniel C. Barth-Jones of Columbia’s Mailman School of Public Health suggests the Weld re-identification may have been a fluke that depended on Weld’s prominence as a public figure who suffered a highly publicized medical incident. For ordinary folks, the risks of such an identification are much lower.

The facts of the Weld case are not in dispute. On May 18, 1996, Weld collapsed at a public event. He was diagnosed with the flu and released after a brief hospitalization. With knowledge of Weld’s date of birth and zip code, Sweeney was able to locate Weld’s records in the Massachusetts Group Insurance Commission (GIC) database and verify them with a cross-reference to Cambridge voter-registration records.

Barth-Jones points out that this is not at all the same as finding the records of an arbitrary individual. For one thing, the date and place of his hospitalization were public information. But his bigger concern is with the use of voter registration data to confirm that the GIC records, which had no names associated with them, were truly Weld’s. The danger of a false positive arises from the possibilities that there might be individuals in the  zip code with the same date of birth who are not registered to vote in Cambridge and therefore do not appear in the database. In fact, Barth-Jones concludes that there was only a 62% to 66% probability that the re-identification of Weld through the voter list was correct. The U.S. has no universal listing of citizens by name, let alone by name and address. Voter lists are about as good as it gets.

This is not merely an academic dispute. Barth-Jones credits Sweeney’s 1997 paper for bringing needed limitations on the amount of medical data made public under HIPAA. For example, published records may now only contain a three-digit rather than a five-digit zip code and year, rather than year and day, of birth. This means a much larger number of individuals will share the same basic information, making successful identification far more difficult.

Privacy advocates, however, sometimes continue to argue as if these changes had never been made and that the Weld re-identification is a typical event. For example, Paul Ohm of the University of Colorado Law School argues, “Thus, easy, cheap, powerful re-identification will cause significant harm that is difficult to avoid. Faced with these daunting new challenges, regulators must find new ways to measure the risk to privacy in different contexts.” Barth-Jones maintains that re-identification is nowhere near as cheap and easy as Ohm suggests.

And there is a cost to further restrictions on the availability of data. In a paper entitled “The Tragedy of the Data Commons,” Jane Yakowitz Bambauer of the Brooklyn Law School, who has collaborated with Barth-Jones, writes: “[A]nonymized data is crucial to beneficial social research, and constitutes a public resource–a commons–under threat of depletion…. [S]ince current privacy policies overtax valuable research without reducing any realistic risks, law should provide a safe harbor for the dissemination of research data.”

Published by

Steve Wildstrom

Steve Wildstrom is veteran technology reporter, writer, and analyst based in the Washington, D.C. area. He created and wrote BusinessWeek’s Technology & You column for 15 years. Since leaving BusinessWeek in the fall of 2009, he has written his own blog, Wildstrom on Tech and has contributed to corporate blogs, including those of Cisco and AMD and also consults for major technology companies.

972 thoughts on “Can You Be Identified from Anonymous Data? It’s Not So Simple”

  1. Thẳng đá Bóng Hôm Nay, Link Coi đá Bóng Trực Tuyến 24h ty le bong daĐội tuyển nước ta chỉ cần một kết quả hòa có bàn thắng nhằm lần loại hai góp mặt tại World Cup futsal. Nhưng, nhằm thực hiện được điều đó

  2. Thanks on your marvelous posting! I seriously enjoyed reading it, you’re a greatauthor. I will make certain to bookmark your blog and will often come back later on. Iwant to encourage one to continue your great writing, have a nice holiday weekend!

  3. A motivating discussion is definitely worth comment.I believe that you should write more on this subject,it may not be a taboo subject but typically people don’t discuss such issues.To the next! Kind regards!!

  4. Having read this I believed it was very informative.I appreciate you taking the time and effort to put this content together.I once again find myself spending a lot of time both reading and commenting.But so what, it was still worthwhile!

  5. I have to thank you for the efforts you have put in penning this blog. I really hope to check out the same high-grade blog posts by you in the future as well. In truth, your creative writing abilities has motivated me to get my very own blog now

  6. It’s actually a nice and helpful piece of information. I am glad that you simply shared this useful information with us. Please keep us up to date like this. Thanks for sharing.

  7. I don’t even know how I ended up here, but I thought this post was good.I do not know who you are but definitely you’re going to a famous blogger if you arenot already Cheers!

  8. Undeniably believe that which you said. Your favorite
    reason seemed to be on the web the easiest thing to
    be aware of. I say to you, I certainly get irked while people consider worries that they just don’t know about.
    You managed to hit the nail upon the top as well as defined out the whole thing without having side-effects ,
    people could take a signal. Will probably be back to get more.

  9. Pretty great post. I simply stumbled upon your blog and wished to mention that I have really loved browsing
    your weblog posts. In any case I’ll be subscribing for your
    rss feed and I’m hoping you write again soon!

  10. SightCare is a powerful formula that supports healthy eyes the natural way. It is specifically designed for both men and women who are suffering from poor eyesight.

  11. Quietum Plus is a 100% natural supplement designed to address ear ringing and other hearing issues. This formula uses only the best in class and natural ingredients to achieve desired results.

  12. GlucoTrust 75% off for sale. GlucoTrust is a dietary supplement that has been designed to support healthy blood sugar levels and promote weight loss in a natural way.

  13. SightCare works by targeting the newly discovered root cause of vision impairment. According to research studies carried out by great universities and research centers, this root cause is a decrease in the antioxidant levels in the body.

  14. Cortexi – $49/bottle price official website. Cortexi is a natural formulas to support healthy hearing and mental sharpness well into your golden years.

  15. Nervogen Pro is a dietary formula that contains 100% natural ingredients. The powerful blend of ingredients claims to support a healthy nervous system. Each capsule includes herbs and antioxidants that protect the nerve against damage and nourishes the nerves with the required nutrients. Order Your Nervogen Pro™ Now!

  16. The CBD SEO Agency delivers top-notch services quest of businesses in the thriving CBD industry. With a vital propose to to Search Engine Optimization (SEO), they cbd seo agency overshadow in enhancing online visibility and driving organic traffic. Their savvy lies in tailoring SEO strategies specifically quest of CBD companies, navigating the one of a kind challenges of this hollow market. Completely wide keyword investigating, theme optimization, and link-building tactics, they effectively encouragement search rankings, ensuring clients stand inaccurate amidst competition. Their team’s dedication to staying updated with industry trends and search appliance algorithms ensures a emphatic and junk approach. The CBD SEO Instrumentality’s commitment to transparency and customer communication fosters keeping and reliability. Overall, their specialized services cater to the explicit needs of CBD businesses, making them a valuable participant in navigating the digital aspect within this competitive market.

  17. Prostadine works really well because it’s made from natural things. The people who made it spent a lot of time choosing these natural things to help your mind work better without any bad effects.

  18. Achieve real weight loss success with ProvaSlim provides real Weight loss powder, weight gain health benefits, toxin elimination, and helps users better digestion.

  19. I really like your blog.. very nice colors & theme.
    Did you make this website yourself or did you hire someone to do it for you?

    Plz reply as I’m looking to create my own blog and would like to find out where u got this
    from. thanks

  20. Woah! I’m really digging the template/theme of this site.
    It’s simple, yet effective. A lot of times it’s tough to get that “perfect balance” between usability and appearance.
    I must say you have done a superb job with this. Also, the blog loads very fast for me on Firefox.
    Exceptional Blog!

  21. ラブドール 性的アシスタントツールの悪名と利点シリコンセックスドールは将来女性に取って代わるでしょうか?ここにゲイのダッチワイフについてつぶされた主な6つの伝説があります現実的なダッチワイフは女性よりも優れていますか?本当

  22. Boostaro increases blood flow to the reproductive organs, leading to stronger and more vibrant erections. It provides a powerful boost that can make you feel like you’ve unlocked the secret to firm erections

  23. Neotonics is a dietary supplement that offers help in retaining glowing skin and maintaining gut health for its users. It is made of the most natural elements that mother nature can offer and also includes 500 million units of beneficial microbiome.

  24. EyeFortin is a natural vision support formula crafted with a blend of plant-based compounds and essential minerals. It aims to enhance vision clarity, focus, and moisture balance.

  25. GlucoBerry is a meticulously crafted supplement designed by doctors to support healthy blood sugar levels by harnessing the power of delphinidin—an essential compound.

  26. Nervogen Pro, A Cutting-Edge Supplement Dedicated To Enhancing Nerve Health And Providing Natural Relief From Discomfort. Our Mission Is To Empower You To Lead A Life Free From The Limitations Of Nerve-Related Challenges. With A Focus On Premium Ingredients And Scientific Expertise.

  27. HoneyBurn is a 100% natural honey mixture formula that can support both your digestive health and fat-burning mechanism. Since it is formulated using 11 natural plant ingredients, it is clinically proven to be safe and free of toxins, chemicals, or additives.

  28. Amiclear is a dietary supplement designed to support healthy blood sugar levels and assist with glucose metabolism. It contains eight proprietary blends of ingredients that have been clinically proven to be effective.

  29. Claritox Pro™ is a natural dietary supplement that is formulated to support brain health and promote a healthy balance system to prevent dizziness, risk injuries, and disability. This formulation is made using naturally sourced and effective ingredients that are mixed in the right way and in the right amounts to deliver effective results.

  30. Dentitox Pro is a liquid dietary solution created as a serum to support healthy gums and teeth. Dentitox Pro formula is made in the best natural way with unique, powerful botanical ingredients that can support healthy teeth.

  31. Glucofort Blood Sugar Support is an all-natural dietary formula that works to support healthy blood sugar levels. It also supports glucose metabolism. According to the manufacturer, this supplement can help users keep their blood sugar levels healthy and within a normal range with herbs, vitamins, plant extracts, and other natural ingredients.

  32. GlucoFlush Supplement is an all-new blood sugar-lowering formula. It is a dietary supplement based on the Mayan cleansing routine that consists of natural ingredients and nutrients.

  33. While Inchagrow is marketed as a dietary supplement, it is important to note that dietary supplements are regulated by the FDA. This means that their safety and effectiveness, and there is 60 money back guarantee that Inchagrow will work for everyone.

  34. Gorilla Flow is a non-toxic supplement that was developed by experts to boost prostate health for men. It’s a blend of all-natural nutrients, including Pumpkin Seed Extract Stinging Nettle Extract, Gorilla Cherry and Saw Palmetto, Boron, and Lycopene.

  35. Nervogen Pro is a cutting-edge dietary supplement that takes a holistic approach to nerve health. It is meticulously crafted with a precise selection of natural ingredients known for their beneficial effects on the nervous system. By addressing the root causes of nerve discomfort, Nervogen Pro aims to provide lasting relief and support for overall nerve function.

  36. Introducing FlowForce Max, a solution designed with a single purpose: to provide men with an affordable and safe way to address BPH and other prostate concerns. Unlike many costly supplements or those with risky stimulants, we’ve crafted FlowForce Max with your well-being in mind. Don’t compromise your health or budget – choose FlowForce Max for effective prostate support today!

  37. GlucoCare is a dietary supplement designed to promote healthy blood sugar levels, manage weight, and curb unhealthy sugar absorption. It contains a natural blend of ingredients that target the root cause of unhealthy glucose levels.

  38. SonoVive is an all-natural supplement made to address the root cause of tinnitus and other inflammatory effects on the brain and promises to reduce tinnitus, improve hearing, and provide peace of mind. SonoVive is is a scientifically verified 10-second hack that allows users to hear crystal-clear at maximum volume. The 100% natural mix recipe improves the ear-brain link with eight natural ingredients. The treatment consists of easy-to-use pills that can be added to one’s daily routine to improve hearing health, reduce tinnitus, and maintain a sharp mind and razor-sharp focus.

  39. TerraCalm is an antifungal mineral clay that may support the health of your toenails. It is for those who struggle with brittle, weak, and discoloured nails. It has a unique blend of natural ingredients that may work to nourish and strengthen your toenails.

  40. I’m in love with the cbd products and organic face mask for dry skin ! The serum gave my shell a youthful help, and the lip balm kept my lips hydrated all day. Eloquent I’m using clean, bona fide products makes me desire great. These are now my must-haves in support of a saucy and nourished look!

  41. Hiya very nice blog!! Guy .. Beautiful .. Amazing ..
    I’ll bookmark your blog and take the feeds additionally?
    I’m happy to find so many helpful info right here in the post, we want work out extra strategies on this regard, thanks for sharing.
    . . . . .

  42. Cortexi is an effective hearing health support formula that has gained positive user feedback for its ability to improve hearing ability and memory. This supplement contains natural ingredients and has undergone evaluation to ensure its efficacy and safety. Manufactured in an FDA-registered and GMP-certified facility, Cortexi promotes healthy hearing, enhances mental acuity, and sharpens memory.