Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work

- Autor:
- Q. Ethan McCallum
- Promocja Przejdź


- Ocena:
- Bądź pierwszym, który oceni tę książkę
- Stron:
- 264
- Dostępne formaty:
-
ePubMobi
Opis książki: Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work
What is bad data? Some people consider it a technical phenomenon, like missing values or malformed records, but bad data includes a lot more. In this handbook, data expert Q. Ethan McCallum has gathered 19 colleagues from every corner of the data arena to reveal how they’ve recovered from nasty data problems.
From cranky storage to poor representation to misguided policy, there are many paths to bad data. Bottom line? Bad data is data that gets in the way. This book explains effective ways to get around it.
Among the many topics covered, you’ll discover how to:
- Test drive your data to see if it’s ready for analysis
- Work spreadsheet data into a usable form
- Handle encoding problems that lurk in text data
- Develop a successful web-scraping effort
- Use NLP tools to reveal the real sentiment of online reviews
- Address cloud computing issues that can impact your analysis effort
- Avoid policies that create data analysis roadblocks
- Take a systematic approach to data quality analysis
Wybrane bestsellery
-
You're sitting on a pile of interesting data. How do you transform that into money? It's easy to focus on the contents of the data itself, and to succumb to the (rather unimaginative) idea of simply collecting and reselling it in raw form. While that's certainly profitable right now, you'd do wel...
-
It’s tough to argue with R as a high-quality, cross-platform, open source statistical software product—unless you’re in the business of crunching Big Data. This concise book introduces you to several strategies for using R to analyze large datasets, including three chapters on u...(0,00 zł najniższa cena z 30 dni)
80.74 zł
94.99 zł(-15%) -
Managing multiple Red Hat-based systems can be easy--with the right tools. The yum package manager and the Kickstart installation utility are full of power and potential for automatic installation, customization, and updates. Here's what you need to know to take control of your systems.(0,00 zł najniższa cena z 30 dni)
42.42 zł
49.90 zł(-15%) -
Jeżeli sięgniesz po tę książkę, będziesz mieć niepowtarzalną okazję błyskawicznego poznania jego potencjału. Na kolejnych stronach znajdziesz informacje na temat podstaw pracy z PL/SQL, a następnie przejdziesz do bardziej zaawansowanych zagadnień. Zdobędziesz wiedzę na temat struktur sterujących,...
Oracle Database 12c. Programowanie w języku PL/SQL Oracle Database 12c. Programowanie w języku PL/SQL
(0,00 zł najniższa cena z 30 dni)74.50 zł
149.00 zł(-50%) -
Znajdziesz tu klarowne, jasne informacje dotyczące kolejnych etapów projektowania oraz implementacji bazy danych, z podziałem na dwie odrębne metody — modelowanie i normalizację. Poznasz obszerne podstawy języka SQL — pojęcia, typy danych, składnię i całe zestawy poleceń — i na ...(0,00 zł najniższa cena z 30 dni)
17.45 zł
34.90 zł(-50%) -
Praktyczny przewodnik po podstawach SQL Database Rozszerz swoje umiejętności i samodzielnie poznaj podstawy platformy Microsoft Azure SQL Database. Jeśli jesteś doświadczonym projektantem oprogramowania lub specjalistą od baz danych, ale nowicjuszem w dziedzinie chmury Microsoft Azure lub SQL Dat...(0,00 zł najniższa cena z 30 dni)
83.16 zł
92.40 zł(-10%) -
There’s a lot of information about big data technologies, but splicing these technologies into an end-to-end enterprise data platform is a daunting task not widely covered. With this practical book, you’ll learn how to build big data infrastructure both on-premises and in the cloud an...
Architecting Modern Data Platforms. A Guide to Enterprise Hadoop at Scale Architecting Modern Data Platforms. A Guide to Enterprise Hadoop at Scale
(0,00 zł najniższa cena z 30 dni)305.15 zł
359.00 zł(-15%) -
This book teaches you everything you need to know to create stunning Vaadin applications for all your web development needs. Deep dive into advanced Vaadin concepts while creating your very own sample Vaadin application.
-
The infrastructure-as-code revolution in IT is also affecting database administration. With this practical book, developers, system administrators, and junior to mid-level DBAs will learn how the modern practice of site reliability engineering applies to the craft of database architecture and ope...
Database Reliability Engineering. Designing and Operating Resilient Database Systems Database Reliability Engineering. Designing and Operating Resilient Database Systems
(0,00 zł najniższa cena z 30 dni)169.15 zł
199.00 zł(-15%) -
Build data-intensive applications locally and deploy at scale using the combined powers of Python and Spark 2.0About This BookLearn why and how you can efficiently use Python to process data and build machine learning models in Apache Spark 2.0Develop and deploy efficient, scalable real-time Spar...
Ebooka przeczytasz na:
-
czytnikach Inkbook, Kindle, Pocketbook i innych
-
systemach Windows, MacOS i innych
-
systemach Windows, Android, iOS, HarmonyOS
-
na dowolnych urządzeniach i aplikacjach obsługujących formaty: PDF, EPub, Mobi
Masz pytania? Zajrzyj do zakładki Pomoc »
Audiobooka posłuchasz:
-
w aplikacji Ebookpoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych
-
na dowolonych urządzeniach i aplikacjach obsługujących format MP3 (pliki spakowane w ZIP)
Masz pytania? Zajrzyj do zakładki Pomoc »
Kurs Video zobaczysz:
-
w aplikacji Ebookpoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych
-
na dowolonych urządzeniach i aplikacjach obsługujących format MP4 (pliki spakowane w ZIP)
Szczegóły książki
- ISBN Ebooka:
- 978-14-493-2497-1, 9781449324971
- Data wydania ebooka:
-
2012-11-07
Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie. Jeśli masz wątpliwości skontaktuj się z nami sklep@helion.pl.
- Język publikacji:
- angielski
- Rozmiar pliku ePub:
- 4.0MB
- Rozmiar pliku Mobi:
- 9.0MB
- Kategorie:
Bazy danych
Spis treści książki
- Bad Data Handbook
- About the Authors
- Preface
- Conventions Used in This Book
- Using Code Examples
- Safari Books Online
- How to Contact Us
- Acknowledgments
- 1. Setting the Pace: What Is Bad Data?
- 2. Is It Just Me, or Does This Data Smell Funny?
- Understand the Data Structure
- Field Validation
- Value Validation
- Physical Interpretation of Simple Statistics
- Visualization
- Keyword PPC Example
- Search Referral Example
- Recommendation Analysis
- Time Series Data
- Conclusion
- 3. Data Intended for Human Consumption, Not Machine Consumption
- The Data
- The Problem: Data Formatted for Human Consumption
- The Arrangement of Data
- Data Spread Across Multiple Files
- The Solution: Writing Code
- Reading Data from an Awkward Format
- Reading Data Spread Across Several Files
- Postscript
- Other Formats
- Summary
- 4. Bad Data Lurking in Plain Text
- Which Plain Text Encoding?
- Guessing Text Encoding
- Normalizing Text
- Problem: Application-Specific Characters Leaking into Plain Text
- Text Processing with Python
- Exercises
- 5. (Re)Organizing the Webs Data
- Can You Get That?
- General Workflow Example
- robots.txt
- Identifying the Data Organization Pattern
- Store Offline Version for Parsing
- Scrape the Information Off the Page
- The Real Difficulties
- Download the Raw Content If Possible
- Forms, Dialog Boxes, and New Windows
- Flash
- The Dark Side
- Conclusion
- 6. Detecting Liars and the Confused in Contradictory Online Reviews
- Weotta
- Getting Reviews
- Sentiment Classification
- Polarized Language
- Corpus Creation
- Training a Classifier
- Validating the Classifier
- Designing with Data
- Lessons Learned
- Summary
- Resources
- 7. Will the Bad Data Please Stand Up?
- Example 1: Defect Reduction in Manufacturing
- Example 2: Whos Calling?
- Example 3: When Typical Does Not Mean Average
- Lessons Learned
- Will This Be on the Test?
- 8. Blood, Sweat, and Urine
- A Very Nerdy Body Swap Comedy
- How Chemists Make Up Numbers
- All Your Database Are Belong to Us
- Check, Please
- Live Fast, Die Young, and Leave a Good-Looking Corpse Code Repository
- Rehab for Chemists (and Other Spreadsheet Abusers)
- tl;dr
- 9. When Data and Reality Dont Match
- Whose Ticker Is It Anyway?
- Splits, Dividends, and Rescaling
- Bad Reality
- Conclusion
- 10. Subtle Sources of Bias and Error
- Imputation Bias: General Issues
- Reporting Errors: General Issues
- Other Sources of Bias
- Topcoding/Bottomcoding
- Seam Bias
- Proxy Reporting
- Sample Selection
- Conclusions
- References
- 11. Dont Let the Perfect Be the Enemy of the Good: Is Bad Data Really Bad?
- But First, Lets Reflect on Graduate School
- Moving On to the Professional World
- Moving into Government Work
- Government Data Is Very Real
- Service Call Data as an Applied Example
- Moving Forward
- Lessons Learned and Looking Ahead
- 12. When Databases Attack: A Guide for When to Stick to Files
- History
- Building My Toolset
- The Roadblock: My Datastore
- History
- Consider Files as Your Datastore
- Files Are Simple!
- Files Work with Everything
- Files Can Contain Any Data Type
- Data Corruption Is Local
- They Have Great Tooling
- Theres No Install Tax
- File Concepts
- Encoding
- Text Files
- Binary Data
- Memory-Mapped Files
- File Formats
- Delimiters
- A Web Framework Backed by Files
- Motivation
- Implementation
- Reflections
- 13. Crouching Table, Hidden Network
- A Relational Cost Allocations Model
- The Delicate Sound of a Combinatorial Explosion
- The Hidden Network Emerges
- Storing the Graph
- Navigating the Graph with Gremlin
- Finding Value in Network Properties
- Think in Terms of Multiple Data Models and Use the Right Tool for the Job
- Acknowledgments
- 14. Myths of Cloud Computing
- Introduction to the Cloud
- What Is The Cloud?
- The Cloud and Big Data
- Introducing Fred
- At First Everything Is Great
- They Put 100% of Their Infrastructure in the Cloud
- As Things Grow, They Scale Easily at First
- Then Things Start Having Trouble
- They Need to Improve Performance
- Higher IO Becomes Critical
- A Major Regional Outage Causes Massive Downtime
- Higher IO Comes with a Cost
- Data Sizes Increase
- Geo Redundancy Becomes a Priority
- Horizontal Scale Isnt as Easy as They Hoped
- Costs Increase Dramatically
- Freds Follies
- Myth 1: Cloud Is a Great Solution for All Infrastructure Components
- How This Myth Relates to Freds Story
- Myth 2: Cloud Will Save Us Money
- How This Myth Relates to Freds Story
- Myth 3: Cloud IO Performance Can Be Improved to Acceptable Levels Through Software RAID
- How This Myth Relates to Freds Story
- Myth 4: Cloud Computing Makes Horizontal Scaling Easy
- How This Myth Relates to Freds Story
- Conclusion and Recommendations
- 15. The Dark Side of Data Science
- Avoid These Pitfalls
- Know Nothing About Thy Data
- Be Inconsistent in Cleaning and Organizing the Data
- Assume Data Is Correct and Complete
- Spillover of Time-Bound Data
- Thou Shalt Provide Your Data Scientists with a Single Tool for All Tasks
- Using a Production Environment for Ad-Hoc Analysis
- The Ideal Data Science Environment
- Thou Shalt Analyze for Analysis Sake Only
- Thou Shalt Compartmentalize Learnings
- Thou Shalt Expect Omnipotence from Data Scientists
- Where Do Data Scientists Live Within the Organization?
- Final Thoughts
- 16. How to Feed and Care for Your Machine-Learning Experts
- Define the Problem
- Fake It Before You Make It
- Create a Training Set
- Pick the Features
- Encode the Data
- Split Into Training, Test, and Solution Sets
- Describe the Problem
- Respond to Questions
- Integrate the Solutions
- Conclusion
- 17. Data Traceability
- Why?
- Personal Experience
- Snapshotting
- Saving the Source
- Weighting Sources
- Backing Out Data
- Separating Phases (and Keeping them Pure)
- Identifying the Root Cause
- Finding Areas for Improvement
- Immutability: Borrowing an Idea from Functional Programming
- An Example
- Crawlers
- Change
- Clustering
- Popularity
- Conclusion
- 18. Social Media: Erasable Ink?
- Social Media: Whose Data Is This Anyway?
- Control
- Commercial Resyndication
- Expectations Around Communication and Expression
- Technical Implications of New End User Expectations
- What Does the Industry Do?
- Validation API
- Update Notification API
- What Should End Users Do?
- How Do We Work Together?
- 19. Data Quality Analysis Demystified: Knowing When Your Data Is Good Enough
- Framework Introduction: The Four Cs of Data Quality Analysis
- Complete
- Coherent
- Correct
- aCcountable
- Conclusion
- Index
- About the Author
- Colophon
- Copyright
O'Reilly Media - inne książki
-
FinOps brings financial accountability to the variable spend model of cloud. Used by the majority of global enterprises, this management practice has grown from a fringe activity to the de facto discipline managing cloud spend. In this book, authors J.R. Storment and Mike Fuller outline the proce...(0,00 zł najniższa cena z 30 dni)
262.65 zł
309.00 zł(-15%) -
Edge AI is transforming the way computers interact with the real world, allowing IoT devices to make decisions using the 99% of sensor data that was previously discarded due to cost, bandwidth, or power limitations. With techniques like embedded machine learning, developers can capture human intu...(0,00 zł najniższa cena z 30 dni)
262.65 zł
309.00 zł(-15%) -
Why is it difficult for so many companies to get digital identity right? If you're still wrestling with even simple identity problems like modern website authentication, this practical book has the answers you need. Author Phil Windley provides conceptual frameworks to help you make sense of all ...(0,00 zł najniższa cena z 30 dni)
186.15 zł
219.00 zł(-15%) -
Python was recently ranked as today's most popular programming language on the TIOBE index, thanks to its broad applicability to design and prototyping to testing, deployment, and maintenance. With this updated fourth edition, you'll learn how to get the most out of Python, whether you're a profe...(0,00 zł najniższa cena z 30 dni)
305.15 zł
359.00 zł(-15%) -
With the accelerating speed of business and the increasing dependence on technology, companies today are significantly changing the way they build in-house business solutions. Many now use low-code and no code technologies to help them deal with specific issues, but that's just the beginning. Wit...
Building Solutions with the Microsoft Power Platform Building Solutions with the Microsoft Power Platform
(0,00 zł najniższa cena z 30 dni)262.65 zł
309.00 zł(-15%) -
Companies are scrambling to integrate AI into their systems and operations. But to build truly successful solutions, you need a firm grasp of the underlying mathematics. This accessible guide walks you through the math necessary to thrive in the AI field such as focusing on real-world application...(0,00 zł najniższa cena z 30 dni)
262.65 zł
309.00 zł(-15%) -
DevOps engineers, developers, and security engineers have ever-changing roles to play in today's cloud native world. In order to build secure and resilient applications, you have to be equipped with security knowledge. Enter security as code.In this book, authors BK Sarthak Das and Virginia Chu d...(0,00 zł najniższa cena z 30 dni)
186.15 zł
219.00 zł(-15%) -
With the increasing use of AI in high-stakes domains such as medicine, law, and defense, organizations spend a lot of time and money to make ML models trustworthy. Many books on the subject offer deep dives into theories and concepts. This guide provides a practical starting point to help develop...(0,00 zł najniższa cena z 30 dni)
262.65 zł
309.00 zł(-15%) -
Why are so many companies adopting GitOps for their DevOps and cloud native strategy? This reliable framework is quickly becoming the standard method for deploying apps to Kubernetes. With this practical, developer-oriented book, DevOps engineers, developers, IT architects, and SREs will learn th...(0,00 zł najniższa cena z 30 dni)
262.65 zł
309.00 zł(-15%) -
Learn the essentials of working with Flutter and Dart to build full stack applications that meet the needs of a cloud-driven world. Together, the Flutter open source UI software development kit and the Dart programming language for client development provide a unified solution to building applica...(0,00 zł najniższa cena z 30 dni)
220.15 zł
259.00 zł(-15%)
Dzieki opcji "Druk na żądanie" do sprzedaży wracają tytuły Grupy Helion, które cieszyły sie dużym zainteresowaniem, a których nakład został wyprzedany.
Dla naszych Czytelników wydrukowaliśmy dodatkową pulę egzemplarzy w technice druku cyfrowego.
Co powinieneś wiedzieć o usłudze "Druk na żądanie":
- usługa obejmuje tylko widoczną poniżej listę tytułów, którą na bieżąco aktualizujemy;
- cena książki może być wyższa od początkowej ceny detalicznej, co jest spowodowane kosztami druku cyfrowego (wyższymi niż koszty tradycyjnego druku offsetowego). Obowiązująca cena jest zawsze podawana na stronie WWW książki;
- zawartość książki wraz z dodatkami (płyta CD, DVD) odpowiada jej pierwotnemu wydaniu i jest w pełni komplementarna;
- usługa nie obejmuje książek w kolorze.
W przypadku usługi "Druk na żądanie" termin dostarczenia przesyłki może obejmować także czas potrzebny na dodruk (do 10 dni roboczych)
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.
Książka, którą chcesz zamówić pochodzi z końcówki nakładu. Oznacza to, że mogą się pojawić drobne defekty (otarcia, rysy, zagięcia).
Co powinieneś wiedzieć o usłudze "Końcówka nakładu":
- usługa obejmuje tylko książki oznaczone tagiem "Końcówka nakładu";
- wady o których mowa powyżej nie podlegają reklamacji;
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.


Oceny i opinie klientów: Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work Q. Ethan McCallum (0)
Weryfikacja opinii następuję na podstawie historii zamówień na koncie Użytkownika umieszczającego opinię. Użytkownik mógł otrzymać punkty za opublikowanie opinii uprawniające do uzyskania rabatu w ramach Programu Punktowego.