Megan Squire - Clean Data - Data Science Strategies for Tackling Dirty Data
Here you can read online Megan Squire - Clean Data - Data Science Strategies for Tackling Dirty Data full text of the book (entire story) in english for free. Download pdf and epub, get meaning, cover and reviews about this ebook. year: 2015, publisher: Packt Publishing, genre: Computer. Description of the work, (preface) as well as reviews are available. Best literature library LitArk.com created for fans of good reading and offers a wide selection of genres:
Romance novel
Science fiction
Adventure
Detective
Science
History
Home and family
Prose
Art
Politics
Computer
Non-fiction
Religion
Business
Children
Humor
Choose a favorite category and find really read worthwhile books. Enjoy immersion in the world of imagination, feel the emotions of the characters or learn something new for yourself, make an fascinating discovery.
- Book:Clean Data - Data Science Strategies for Tackling Dirty Data
- Author:
- Publisher:Packt Publishing
- Genre:
- Year:2015
- Rating:4 / 5
- Favourites:Add to favourites
- Your mark:
Clean Data - Data Science Strategies for Tackling Dirty Data: summary, description and annotation
We offer to read an annotation, description, summary or preface (depends on what the author of the book "Clean Data - Data Science Strategies for Tackling Dirty Data" wrote himself). If you haven't found the necessary information about the book — write in the comments, we will try to find it.
- Grow your data science expertise by filling your toolbox with proven strategies for a wide variety of cleaning challenges
- Familiarize yourself with the crucial data cleaning processes, and share your own clean data sets with others
- Complete real-world projects using data from Twitter and Stack Overflow
Is much of your time spent doing tedious tasks such as cleaning dirty data, accounting for lost data, and preparing data to be used by others? If so, then having the right tools makes a critical difference, and will be a great investment as you grow your data science expertise.
The book starts by highlighting the importance of data cleaning in data science, and will show you how to reap rewards from reforming your cleaning process. Next, you will cement your knowledge of the basic concepts that the rest of the book relies on: file formats, data types, and character encodings. You will also learn how to extract and clean data stored in RDBMS, web files, and PDF documents, through practical examples.
At the end of the book, you will be given a chance to tackle a couple of real-world projects.
What you will learn- Understand the role of data cleaning in the overall data science process
- Learn the basics of file formats, data types, and character encodings to clean data properly
- Master critical features of the spreadsheet and text editor for organizing and manipulating data
- Convert data from one common format to another, including JSON, CSV, and some special-purpose formats
- Implement three different strategies for parsing and cleaning data found in HTML files on the Web
- Reveal the mysteries of PDF documents and learn how to pull out just the data you want
- Develop a range of solutions for detecting and cleaning bad data stored in an RDBMS
- Create your own clean data sets that can be packaged, licensed, and shared with others
- Use the tools from this book to complete two real-world projects using data from Twitter and Stack Overflow
Megan Squire is a professor of computing sciences at Elon University. She has been collecting and cleaning dirty data for two decades. She is also the leader of FLOSSmole.org, a research project to collect data and analyze it in order to learn how free, libre, and open source software is made.
Table of Contents- Why Do You Need Clean Data?
- Fundamentals Formats, Types, and Encodings
- Workhorses of Clean Data Spreadsheets and Text Editors
- Speaking the Lingua Franca Data Conversions
- Collecting and Cleaning Data from the Web
- Cleaning Data in Pdf Files
- RDBMS Cleaning Techniques
- Best Practices for Sharing Your Clean Data
- Stack Overflow Project
- Twitter Project
Megan Squire: author's other books
Who wrote Clean Data - Data Science Strategies for Tackling Dirty Data? Find out the surname, the name of the author of the book and a list of all author's works by series.
![Michael R. Brzustowicz [Michael R. Brzustowicz] - Data Science with Java](/uploads/posts/book/119626/thumbs/michael-r-brzustowicz-michael-r-brzustowicz.jpg)
Clean Data - Data Science Strategies for Tackling Dirty Data — read online for free the complete book (whole text) full work
Below is the text of the book, divided by pages. System saving the place of the last page read, allows you to conveniently read the book "Clean Data - Data Science Strategies for Tackling Dirty Data" online for free, without having to search again every time where you left off. Put a bookmark, and you can go to the page where you finished reading at any time.
Font size:
Interval:
Bookmark:
Copyright 2015 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.
Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.
First published: May 2015
Production reference: 1190515
Published by Packt Publishing Ltd.
Livery Place
35 Livery Street
Birmingham B3 2PB, UK.
ISBN 978-1-78528-401-4
www.packtpub.com
Author
Megan Squire
Reviewers
J. Benjamin Cook
Richard A. Denman, Jr.
Oskar Jarczyk
Commissioning Editor
Akram Hussain
Acquisition Editor
Harsha Bharwani
Content Development Editor
Mamata Walkar
Technical Editor
Nilesh Mangnakar
Copy Editors
Puja Lalwani
Aditya Nair
Stuti Srivastava
Project Coordinator
Shipra Chawhan
Proofreaders
Stephen Copestake
Safis Editing
Indexer
Priya Sane
Production Coordinator
Shantanu N. Zagade
Cover Work
Shantanu N. Zagade
Megan Squire is a professor of computing sciences at Elon University. She has been collecting and cleaning dirty data for two decades. She is also the leader of FLOSSmole.org, a research project to collect data and analyze it in order to learn how free, libre, and open source software is made.
J. Benjamin Cook , after studying sociology at the University of Nebraska-Lincoln, earned his master's in computational science and engineering from the Institute of Applied Computational Science at Harvard University. Currently, he is helping build the data science team at Hudl, a sports software company whose mission is to capture and bring value to every moment in sports. When he's not learning about all things data, Ben spends time with his daughters and his beautiful wife, Renee.
Richard A. Denman, Jr. is a senior consultant with Numb3rs and has over 30 years of experience providing services to major companies in the areas of data analytics, data science, optimization, process improvement, and information technology. He has been a member of the Association for Computing Machinery (ACM) and the Institute of Electrical and Electronics Engineers (IEEE) for over 25 years. He is also a member of the Institute for Operations Research and the Management Sciences (INFORMS) and the American Society for Quality (ASQ).
I would like to thank my wife, Barbara, my son, Ashford, and my daughter, Addie, for their support in producing this book.
Oskar Jarczyk graduated from Polish-Japanese Academy of Information Technology with an MSc Eng. degree in computer science (major databases). After three years of commercial work, he returned to academia to become a PhD student in the field of social informatics.
His academic work is connected with problems in the category of web intelligence, especially free/libre open-source software (FLOSS) and collaborative innovation networks (COINs). He specializes in analyzing the quality of work in open source software teams of developers that are on the GitHub portal. Together with colleagues from the WikiTeams research team, he coped with the problem of "clean data" on a daily basis while creating datasets in MongoDB and MySQL. They were later used with success for FLOSS scientific analyses in the R and Python language.
In his spare time, Oskar reads books about big data and practices kendo.
For support files and downloads related to your book, please visit www.PacktPub.com.
Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at > for more details.
At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.
https://www2.packtpub.com/books/subscription/packtlib
Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can search, access, and read Packt's entire library of books.
- Fully searchable across every book published by Packt
- Copy and paste, print, and bookmark content
- On demand and accessible via a web browser
If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view 9 entirely free books. Simply use your login credentials for immediate access.
"Pray, Mr. Babbage, if you put into the machine the wrong figures, will the right answer come out?" |
| -- Charles Babbage (1864) |
"Garbage in, garbage out" |
| -- The United States Internal Revenue Service (1963) |
"There are no clean datasets." |
| -- Josh Sullivan, Booz Allen VP in Fortune (2015) |
In his 1864 collection of essays, Charles Babbage, the inventor of the first calculating machine, recollects being dumbfounded at the "confusion of ideas" that would prompt someone to assume that a computer could calculate the correct answer despite being given the wrong input. Fast-forward another 100 years, and the tax bureaucracy started patiently explaining "garbage in, garbage out" to express the idea that even for the all-powerful tax collector, computer processing is still dependent on the quality of its input. Fast-forward another 50 years to 2015: a seemingly magical age of machine learning, autocorrect, anticipatory interfaces, and recommendation systems that know me better than I know myself. Yet, all of these helpful algorithms still require high-quality data in order to learn properly in the first place, and we lament "there are no clean datasets".
This book is for anyone who works with data on a regular basis, whether as a data scientist, data journalist, software developer, or something else. The goal is to teach practical strategies to quickly and easily bridge the gap between the data we want and the data we have. We want high-quality, perfect data, but the reality is that most often, our data falls far short. Whether we are plagued with missing data, data in the wrong format, data in the wrong location, or anomalies in the data, the result is often, to paraphrase rapper Notorious B.I.G., "more data, more problems".
Font size:
Interval:
Bookmark:
Similar books «Clean Data - Data Science Strategies for Tackling Dirty Data»
Look at similar books to Clean Data - Data Science Strategies for Tackling Dirty Data. We have selected literature similar in name and meaning in the hope of providing readers with more options to find new, interesting, not yet read works.
Discussion, reviews of the book Clean Data - Data Science Strategies for Tackling Dirty Data and just readers' own opinions. Leave your comments, write what you think about the work, its meaning or the main characters. Specify what exactly you liked and what you didn't like, and why you think so.