Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work
- Autor:
- Q. Ethan McCallum
- Ocena:
- Bądź pierwszym, który oceni tę książkę
- Stron:
- 264
- Dostępne formaty:
-
ePubMobi
Opis ebooka: Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work
What is bad data? Some people consider it a technical phenomenon, like missing values or malformed records, but bad data includes a lot more. In this handbook, data expert Q. Ethan McCallum has gathered 19 colleagues from every corner of the data arena to reveal how they’ve recovered from nasty data problems.
From cranky storage to poor representation to misguided policy, there are many paths to bad data. Bottom line? Bad data is data that gets in the way. This book explains effective ways to get around it.
Among the many topics covered, you’ll discover how to:
- Test drive your data to see if it’s ready for analysis
- Work spreadsheet data into a usable form
- Handle encoding problems that lurk in text data
- Develop a successful web-scraping effort
- Use NLP tools to reveal the real sentiment of online reviews
- Address cloud computing issues that can impact your analysis effort
- Avoid policies that create data analysis roadblocks
- Take a systematic approach to data quality analysis
Wybrane bestsellery
-
You're sitting on a pile of interesting data. How do you transform that into money? It's easy to focus on the contents of the data itself, and to succumb to the (rather unimaginative) idea of simply collecting and reselling it in raw form. While that's certainly profitable right now, you'd do wel...
-
It’s tough to argue with R as a high-quality, cross-platform, open source statistical software product—unless you’re in the business of crunching Big Data. This concise book introduces you to several strategies for using R to analyze large datasets, including three chapters on u...(72.24 zł najniższa cena z 30 dni)
76.42 zł
89.90 zł(-15%) -
Managing multiple Red Hat-based systems can be easy--with the right tools. The yum package manager and the Kickstart installation utility are full of power and potential for automatic installation, customization, and updates. Here's what you need to know to take control of your systems.(38.17 zł najniższa cena z 30 dni)
38.17 zł
44.90 zł(-15%) -
This practical guide to implementing DeFi in your projects guides you through building full-stack DeFi solutions with popular tools and teaches you how to leverage blockchain technologies to manage crypto assets.
Building Full Stack DeFi Applications. A practical guide to creating your own decentralized finance projects on blockchain Building Full Stack DeFi Applications. A practical guide to creating your own decentralized finance projects on blockchain
-
The Definitive Guide to Data Integration is for data eclectics looking to explore the modern data stack. Complete with practical examples and insights, it covering tools, techniques, and best practices to unleash your data's potential.
The Definitive Guide to Data Integration. Unlock the power of data integration to efficiently manage, transform, and analyze data The Definitive Guide to Data Integration. Unlock the power of data integration to efficiently manage, transform, and analyze data
Pierre-Yves BONNEFOY, Emeric CHAIZE, Raphaël MANSUY, Mehdi TAZI, Stephane Heckel
-
Learn T-SQL Querying, Second Edition, is an up-to-date reference designed to help you write more efficient T-SQL code to perform simple-to-advanced tasks for data management and data analysis tasks.
Learn T-SQL Querying. A guide to developing efficient and elegant T-SQL code - Second Edition Learn T-SQL Querying. A guide to developing efficient and elegant T-SQL code - Second Edition
-
With the help of well-structured and practical recipes, this book will teach you how to integrate data from the cloud and on-premises. You’ll learn how to transform, clean, and consolidate data into a single data platform and get to grips with ADF
Azure Data Factory Cookbook. Build ETL, Hybrid ETL, and ELT pipelines using ADF, Synapse Analytics, Fabric and Databricks - Second Edition Azure Data Factory Cookbook. Build ETL, Hybrid ETL, and ELT pipelines using ADF, Synapse Analytics, Fabric and Databricks - Second Edition
Dmitry Foshin, Tonya Chernyshova, Dmitry Anoshin, Xenia Ireton
-
Learn new techniques to ingest, transform, merge, and deliver trusted data to downstream users using modern cloud data architectures and Scala, and learn end-to-end data engineering that will make you the most valuable asset on your data team.
Data Engineering with Scala and Spark. Build streaming and batch pipelines that process massive amounts of data using Scala Data Engineering with Scala and Spark. Build streaming and batch pipelines that process massive amounts of data using Scala
-
This hands-on guide will help you learn various strategies for managing data integrity and data quality using effective frameworks, tools, and strategies. Get ready to explore a range of methods and solutions for finance projects and requirements.
Managing Data Integrity for Finance. Discover practical data quality management strategies for finance analysts and data professionals Managing Data Integrity for Finance. Discover practical data quality management strategies for finance analysts and data professionals
-
Explore the full potential of MongoDB 7.0 with this comprehensive guide that offers powerful techniques for efficient data manipulation, application integration, and security. This intermediate-to-advanced level book empowers you to harness the power of the latest version of MongoDB.
Mastering MongoDB 7.0. Achieve data excellence by unlocking the full potential of MongoDB - Fourth Edition Mastering MongoDB 7.0. Achieve data excellence by unlocking the full potential of MongoDB - Fourth Edition
Marko Aleksendrić, Arek Borucki, Leandro Domingues, Malak Abu Hammad, Elie Hannouch
Ebooka "Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work" przeczytasz na:
-
czytnikach Inkbook, Kindle, Pocketbook, Onyx Boox i innych
-
systemach Windows, MacOS i innych
-
systemach Windows, Android, iOS, HarmonyOS
-
na dowolnych urządzeniach i aplikacjach obsługujących formaty: PDF, EPub, Mobi
Masz pytania? Zajrzyj do zakładki Pomoc »
Audiobooka "Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work" posłuchasz:
-
w aplikacji Ebookpoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych
-
na dowolnych urządzeniach i aplikacjach obsługujących format MP3 (pliki spakowane w ZIP)
Masz pytania? Zajrzyj do zakładki Pomoc »
Kurs Video "Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work" zobaczysz:
-
w aplikacjach Ebookpoint i Videopoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych z dostępem do najnowszej wersji Twojej przeglądarki internetowej
Szczegóły ebooka
- ISBN Ebooka:
- 978-14-493-2497-1, 9781449324971
- Data wydania ebooka:
- 2012-11-07 Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie. Jeśli masz wątpliwości skontaktuj się z nami sklep@ebookpoint.pl.
- Język publikacji:
- angielski
- Rozmiar pliku ePub:
- 4.0MB
- Rozmiar pliku Mobi:
- 9.0MB
Spis treści ebooka
- Bad Data Handbook
- About the Authors
- Preface
- Conventions Used in This Book
- Using Code Examples
- Safari Books Online
- How to Contact Us
- Acknowledgments
- 1. Setting the Pace: What Is Bad Data?
- 2. Is It Just Me, or Does This Data Smell Funny?
- Understand the Data Structure
- Field Validation
- Value Validation
- Physical Interpretation of Simple Statistics
- Visualization
- Keyword PPC Example
- Search Referral Example
- Recommendation Analysis
- Time Series Data
- Conclusion
- 3. Data Intended for Human Consumption, Not Machine Consumption
- The Data
- The Problem: Data Formatted for Human Consumption
- The Arrangement of Data
- Data Spread Across Multiple Files
- The Solution: Writing Code
- Reading Data from an Awkward Format
- Reading Data Spread Across Several Files
- Postscript
- Other Formats
- Summary
- 4. Bad Data Lurking in Plain Text
- Which Plain Text Encoding?
- Guessing Text Encoding
- Normalizing Text
- Problem: Application-Specific Characters Leaking into Plain Text
- Text Processing with Python
- Exercises
- 5. (Re)Organizing the Webs Data
- Can You Get That?
- General Workflow Example
- robots.txt
- Identifying the Data Organization Pattern
- Store Offline Version for Parsing
- Scrape the Information Off the Page
- The Real Difficulties
- Download the Raw Content If Possible
- Forms, Dialog Boxes, and New Windows
- Flash
- The Dark Side
- Conclusion
- 6. Detecting Liars and the Confused in Contradictory Online Reviews
- Weotta
- Getting Reviews
- Sentiment Classification
- Polarized Language
- Corpus Creation
- Training a Classifier
- Validating the Classifier
- Designing with Data
- Lessons Learned
- Summary
- Resources
- 7. Will the Bad Data Please Stand Up?
- Example 1: Defect Reduction in Manufacturing
- Example 2: Whos Calling?
- Example 3: When Typical Does Not Mean Average
- Lessons Learned
- Will This Be on the Test?
- 8. Blood, Sweat, and Urine
- A Very Nerdy Body Swap Comedy
- How Chemists Make Up Numbers
- All Your Database Are Belong to Us
- Check, Please
- Live Fast, Die Young, and Leave a Good-Looking Corpse Code Repository
- Rehab for Chemists (and Other Spreadsheet Abusers)
- tl;dr
- 9. When Data and Reality Dont Match
- Whose Ticker Is It Anyway?
- Splits, Dividends, and Rescaling
- Bad Reality
- Conclusion
- 10. Subtle Sources of Bias and Error
- Imputation Bias: General Issues
- Reporting Errors: General Issues
- Other Sources of Bias
- Topcoding/Bottomcoding
- Seam Bias
- Proxy Reporting
- Sample Selection
- Conclusions
- References
- 11. Dont Let the Perfect Be the Enemy of the Good: Is Bad Data Really Bad?
- But First, Lets Reflect on Graduate School
- Moving On to the Professional World
- Moving into Government Work
- Government Data Is Very Real
- Service Call Data as an Applied Example
- Moving Forward
- Lessons Learned and Looking Ahead
- 12. When Databases Attack: A Guide for When to Stick to Files
- History
- Building My Toolset
- The Roadblock: My Datastore
- History
- Consider Files as Your Datastore
- Files Are Simple!
- Files Work with Everything
- Files Can Contain Any Data Type
- Data Corruption Is Local
- They Have Great Tooling
- Theres No Install Tax
- File Concepts
- Encoding
- Text Files
- Binary Data
- Memory-Mapped Files
- File Formats
- Delimiters
- A Web Framework Backed by Files
- Motivation
- Implementation
- Reflections
- 13. Crouching Table, Hidden Network
- A Relational Cost Allocations Model
- The Delicate Sound of a Combinatorial Explosion
- The Hidden Network Emerges
- Storing the Graph
- Navigating the Graph with Gremlin
- Finding Value in Network Properties
- Think in Terms of Multiple Data Models and Use the Right Tool for the Job
- Acknowledgments
- 14. Myths of Cloud Computing
- Introduction to the Cloud
- What Is The Cloud?
- The Cloud and Big Data
- Introducing Fred
- At First Everything Is Great
- They Put 100% of Their Infrastructure in the Cloud
- As Things Grow, They Scale Easily at First
- Then Things Start Having Trouble
- They Need to Improve Performance
- Higher IO Becomes Critical
- A Major Regional Outage Causes Massive Downtime
- Higher IO Comes with a Cost
- Data Sizes Increase
- Geo Redundancy Becomes a Priority
- Horizontal Scale Isnt as Easy as They Hoped
- Costs Increase Dramatically
- Freds Follies
- Myth 1: Cloud Is a Great Solution for All Infrastructure Components
- How This Myth Relates to Freds Story
- Myth 2: Cloud Will Save Us Money
- How This Myth Relates to Freds Story
- Myth 3: Cloud IO Performance Can Be Improved to Acceptable Levels Through Software RAID
- How This Myth Relates to Freds Story
- Myth 4: Cloud Computing Makes Horizontal Scaling Easy
- How This Myth Relates to Freds Story
- Conclusion and Recommendations
- 15. The Dark Side of Data Science
- Avoid These Pitfalls
- Know Nothing About Thy Data
- Be Inconsistent in Cleaning and Organizing the Data
- Assume Data Is Correct and Complete
- Spillover of Time-Bound Data
- Thou Shalt Provide Your Data Scientists with a Single Tool for All Tasks
- Using a Production Environment for Ad-Hoc Analysis
- The Ideal Data Science Environment
- Thou Shalt Analyze for Analysis Sake Only
- Thou Shalt Compartmentalize Learnings
- Thou Shalt Expect Omnipotence from Data Scientists
- Where Do Data Scientists Live Within the Organization?
- Final Thoughts
- 16. How to Feed and Care for Your Machine-Learning Experts
- Define the Problem
- Fake It Before You Make It
- Create a Training Set
- Pick the Features
- Encode the Data
- Split Into Training, Test, and Solution Sets
- Describe the Problem
- Respond to Questions
- Integrate the Solutions
- Conclusion
- 17. Data Traceability
- Why?
- Personal Experience
- Snapshotting
- Saving the Source
- Weighting Sources
- Backing Out Data
- Separating Phases (and Keeping them Pure)
- Identifying the Root Cause
- Finding Areas for Improvement
- Immutability: Borrowing an Idea from Functional Programming
- An Example
- Crawlers
- Change
- Clustering
- Popularity
- Conclusion
- 18. Social Media: Erasable Ink?
- Social Media: Whose Data Is This Anyway?
- Control
- Commercial Resyndication
- Expectations Around Communication and Expression
- Technical Implications of New End User Expectations
- What Does the Industry Do?
- Validation API
- Update Notification API
- What Should End Users Do?
- How Do We Work Together?
- 19. Data Quality Analysis Demystified: Knowing When Your Data Is Good Enough
- Framework Introduction: The Four Cs of Data Quality Analysis
- Complete
- Coherent
- Correct
- aCcountable
- Conclusion
- Index
- About the Author
- Colophon
- Copyright
O'Reilly Media - inne książki
-
JavaScript gives web developers great power to create rich interactive browser experiences, and much of that power is provided by the browser itself. Modern web APIs enable web-based applications to come to life like never before, supporting actions that once required browser plug-ins. Some are s...(177.65 zł najniższa cena z 30 dni)
186.15 zł
219.00 zł(-15%) -
How will software development and operations have to change to meet the sustainability and green needs of the planet? And what does that imply for development organizations? In this eye-opening book, sustainable software advocates Anne Currie, Sarah Hsu, and Sara Bergman provide a unique overview...(160.65 zł najniższa cena z 30 dni)
177.65 zł
209.00 zł(-15%) -
OpenTelemetry is a revolution in observability data. Instead of running multiple uncoordinated pipelines, OpenTelemetry provides users with a single integrated stream of data, providing multiple sources of high-quality telemetry data: tracing, metrics, logs, RUM, eBPF, and more. This practical gu...(143.65 zł najniższa cena z 30 dni)
152.15 zł
179.00 zł(-15%) -
Interested in developing embedded systems? Since they don't tolerate inefficiency, these systems require a disciplined approach to programming. This easy-to-read guide helps you cultivate good development practices based on classic software design patterns and new patterns unique to embedded prog...(152.15 zł najniższa cena z 30 dni)
160.65 zł
189.00 zł(-15%) -
If you use Linux in your day-to-day work, then Linux Pocket Guide is the perfect on-the-job reference. This thoroughly updated 20th anniversary edition explains more than 200 Linux commands, including new commands for file handling, package management, version control, file format conversions, an...(92.65 zł najniższa cena z 30 dni)
101.15 zł
109.00 zł(-7%) -
Gain the valuable skills and techniques you need to accelerate the delivery of machine learning solutions. With this practical guide, data scientists, ML engineers, and their leaders will learn how to bridge the gap between data science and Lean product delivery in a practical and simple way. Dav...(245.65 zł najniższa cena z 30 dni)
254.15 zł
299.00 zł(-15%) -
This practical book provides a detailed explanation of the zero trust security model. Zero trust is a security paradigm shift that eliminates the concept of traditional perimeter-based security and requires you to "always assume breach" and "never trust but always verify." The updated edition off...(203.15 zł najniższa cena z 30 dni)
211.65 zł
249.00 zł(-15%) -
Decentralized finance (DeFi) is a rapidly growing field in fintech, having grown from $700 million to $100 billion over the past three years alone. But the lack of reliable information makes this area both risky and murky. In this practical book, experienced securities attorney Alexandra Damsker ...(203.15 zł najniższa cena z 30 dni)
211.65 zł
249.00 zł(-15%) -
Whether you're a startup founder trying to disrupt an industry or an entrepreneur trying to provoke change from within, your biggest challenge is creating a product people actually want. Lean Analytics steers you in the right direction.This book shows you how to validate your initial idea, find t...(126.65 zł najniższa cena z 30 dni)
126.65 zł
149.00 zł(-15%) -
When it comes to building user interfaces on the web, React enables web developers to unlock a new world of possibilities. This practical book helps you take a deep dive into fundamental concepts of this JavaScript library, including JSX syntax and advanced patterns, the virtual DOM, React reconc...(194.65 zł najniższa cena z 30 dni)
211.65 zł
249.00 zł(-15%)
Dzieki opcji "Druk na żądanie" do sprzedaży wracają tytuły Grupy Helion, które cieszyły sie dużym zainteresowaniem, a których nakład został wyprzedany.
Dla naszych Czytelników wydrukowaliśmy dodatkową pulę egzemplarzy w technice druku cyfrowego.
Co powinieneś wiedzieć o usłudze "Druk na żądanie":
- usługa obejmuje tylko widoczną poniżej listę tytułów, którą na bieżąco aktualizujemy;
- cena książki może być wyższa od początkowej ceny detalicznej, co jest spowodowane kosztami druku cyfrowego (wyższymi niż koszty tradycyjnego druku offsetowego). Obowiązująca cena jest zawsze podawana na stronie WWW książki;
- zawartość książki wraz z dodatkami (płyta CD, DVD) odpowiada jej pierwotnemu wydaniu i jest w pełni komplementarna;
- usługa nie obejmuje książek w kolorze.
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.
Książka, którą chcesz zamówić pochodzi z końcówki nakładu. Oznacza to, że mogą się pojawić drobne defekty (otarcia, rysy, zagięcia).
Co powinieneś wiedzieć o usłudze "Końcówka nakładu":
- usługa obejmuje tylko książki oznaczone tagiem "Końcówka nakładu";
- wady o których mowa powyżej nie podlegają reklamacji;
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.
Książka drukowana
Oceny i opinie klientów: Bad Data Handbook. Cleaning Up The Data So You Can Get Back To Work Q. Ethan McCallum (0) Weryfikacja opinii następuję na podstawie historii zamówień na koncie Użytkownika umieszczającego opinię. Użytkownik mógł otrzymać punkty za opublikowanie opinii uprawniające do uzyskania rabatu w ramach Programu Punktowego.