• Complain

Andrew Collette - Python and HDF5

Here you can read online Andrew Collette - Python and HDF5 full text of the book (entire story) in english for free. Download pdf and epub, get meaning, cover and reviews about this ebook. year: 2013, publisher: OReilly Media, genre: Computer. Description of the work, (preface) as well as reviews are available. Best literature library LitArk.com created for fans of good reading and offers a wide selection of genres:

Romance novel Science fiction Adventure Detective Science History Home and family Prose Art Politics Computer Non-fiction Religion Business Children Humor

Choose a favorite category and find really read worthwhile books. Enjoy immersion in the world of imagination, feel the emotions of the characters or learn something new for yourself, make an fascinating discovery.

Andrew Collette Python and HDF5
  • Book:
    Python and HDF5
  • Author:
  • Publisher:
    OReilly Media
  • Genre:
  • Year:
    2013
  • Rating:
    4 / 5
  • Favourites:
    Add to favourites
  • Your mark:
    • 80
    • 1
    • 2
    • 3
    • 4
    • 5

Python and HDF5: summary, description and annotation

We offer to read an annotation, description, summary or preface (depends on what the author of the book "Python and HDF5" wrote himself). If you haven't found the necessary information about the book — write in the comments, we will try to find it.

Gain hands-on experience with HDF5 for storing scientific data in Python. This practical guide quickly gets you up to speed on the details, best practices, and pitfalls of using HDF5 to archive and share numerical datasets ranging in size from gigabytes to terabytes.

Through real-world examples and practical exercises, youll explore topics such as scientific datasets, hierarchically organized groups, user-defined metadata, and interoperable files. Examples are applicable for users of both Python 2 and Python 3. If youre familiar with the basics of Python data analysis, this is an ideal introduction to HDF5.

  • Get set up with HDF5 tools and create your first HDF5 file
  • Work with datasets by learning the HDF5 Dataset object
  • Understand advanced features like dataset chunking and compression
  • Learn how to work with HDF5s hierarchical structure, using groups
  • Create self-describing files by adding metadata with HDF5...
  • Andrew Collette: author's other books


    Who wrote Python and HDF5? Find out the surname, the name of the author of the book and a list of all author's works by series.

    Python and HDF5 — read online for free the complete book (whole text) full work

    Below is the text of the book, divided by pages. System saving the place of the last page read, allows you to conveniently read the book "Python and HDF5" online for free, without having to search again every time where you left off. Put a bookmark, and you can go to the page where you finished reading at any time.

    Light

    Font size:

    Reset

    Interval:

    Bookmark:

    Make
    Python and HDF5
    Andrew Collette
    Beijing Cambridge Farnham Kln Sebastopol Tokyo Special Upgrade Offer If you - photo 1

    Beijing Cambridge Farnham Kln Sebastopol Tokyo

    Special Upgrade Offer

    If you purchased this ebook directly from oreilly.com, you have the following benefits:

    • DRM-free ebooksuse your ebooks across devices without restrictions or limitations

    • Multiple formatsuse on your laptop, tablet, or phone

    • Lifetime access, with free updates

    • Dropbox syncingyour files, anywhere

    If you purchased this ebook from another retailer, you can upgrade your ebook to take advantage of all these benefits for just $4.99. to access your ebook upgrade.

    Please note that upgrade offers are not available from sample content.

    Preface

    Over the past several years, Python has emerged as a credible alternative toscientific analysis environments like IDL or MATLAB. Stable core packagesnow exist for handling numerical arrays (NumPy), analysis (SciPy), andplotting (matplotlib). A huge selection of more specialized software is alsoavailable, reducing the amount of work necessary to write scientific codewhile also increasing the quality of results.

    As Python is increasingly used to handle large numerical datasets, moreemphasis has been placed on the use of standard formats for data storageand communication. HDF5, the most recent version of the HierarchicalData Format originally developed at the National Center for Supercomputing Applications (NCSA), has rapidly emerged as themechanism of choice for storing scientific data in Python. At the same time,many researchers who use (or are interested in using) HDF5 have been drawn toPython for its ease of use and rapid development capabilities.

    This book provides an introduction to using HDF5 from Python, and isdesigned to be useful to anyone with a basic background in Python dataanalysis. Only familiarity with Python and NumPy is assumed. Special emphasisis placed on the native HDF5 feature set, rather than higher-level abstractionson the Python side, to make the book as useful as possible for creatingportable files.

    Finally, this book is intended to support both users of Python 2 and Python 3.While the examples are written for Python 2, any differences that may tripyou up are noted in the text.

    Conventions Used in This Book

    The following typographical conventions are used in this book:

    Italic Indicates new terms, URLs, email addresses, filenames, and fileextensions. Constant width Used for program listings, as well as within paragraphs torefer to program elements such as variable or function names, databases, datatypes, environment variables, statements, and keywords. Constant width bold Shows commands or other text that should be typedliterally by the user. Constant width italic Shows text that should be replaced withuser-supplied values or by values determined by context.
    Tip

    This icon signifies a tip, suggestion, or general note.

    Warning

    This icon indicates a warning or caution.

    Using Code Examples

    This book is here to help you get your job done. In general, if example code isoffered with this book, you may use it in your programs and documentation. Youdo not need to contact us for permission unless youre reproducing asignificant portion of the code. For example, writing a program that usesseveral chunks of code from this book does not require permission. Selling ordistributing a CD-ROM of examples from OReilly books does require permission.Answering a question by citing this book and quoting example code does notrequire permission. Incorporating a significant amount of example code fromthis book into your products documentation does require permission.

    We appreciate, but do not require, attribution. An attribution usually includesthe title, author, publisher, and ISBN. For example: Python and HDF5 by Andrew Collette (OReilly). Copyright 2014 Andrew Collette, 978-1-449-36783-1.

    If you feel your use of code examples falls outside fair use or the permissiongiven above, feel free to contact us at.

    Safari Books Online
    Note

    Safari BooksOnline is an on-demand digital library that delivers expertcontent in both bookand video form from the worlds leading authors in technology andbusiness.

    Technology professionals, software developers, web designers, and business andcreative professionals use Safari Books Online as their primary resource forresearch, problem solving, learning, and certification training.

    Safari Books Online offers a range of product mixes andpricing programs for organizations,government agencies,and individuals.Subscribers have access to thousands of books, training videos, andprepublication manuscripts in one fully searchable database from publisherslike OReilly Media, Prentice Hall Professional, Addison-Wesley Professional,Microsoft Press, Sams, Que, Peachpit Press, Focal Press, Cisco Press, JohnWiley & Sons, Syngress, Morgan Kaufmann, IBM Redbooks, Packt, Adobe Press, FTPress, Apress, Manning, New Riders, McGraw-Hill, Jones & Bartlett, CourseTechnology, and dozens more. For moreinformation about Safari Books Online, please visit us online.

    How to Contact Us

    Please address comments and questions concerning this book to the publisher:

    OReilly Media, Inc.
    1005 Gravenstein Highway North
    Sebastopol, CA 95472
    800-998-9938 (in the United States or Canada)
    707-829-0515 (international or local)
    707-829-0104 (fax)

    We have a web page for this book, where we list errata, examples, and anyadditional information. You can access this page athttp://oreil.ly/python-HDF5.

    To comment or ask technical questions about this book, send email to.

    For more information about our books, courses, conferences, and news, see ourwebsite at http://www.oreilly.com.

    Find us on Facebook: http://facebook.com/oreilly

    Follow us on Twitter: http://twitter.com/oreillymedia

    Watch us on YouTube: http://www.youtube.com/oreillymedia

    Acknowledgments

    I would like to thank Quincey Koziol, Elena Pourmal, Gerd Heber, and the others atthe HDF Group for supporting the use of HDF5 by the Python community.This book benefited greatly from reviewer comments, including those byEli Bressert and Anthony Scopatz, as well as the dedication and guidanceof OReilly editor Meghan Blanchette.

    Darren Dale and many others deserve thanks for contributing tothe h5py project, along with Francesc Alted, Antonio Valentino, and fellowauthors of PyTables who first brought the HDF5 and Python worlds together.I would also like to thank Steve Vincena and Walter Gekelman of theUCLA Basic Plasma Science Facility, where I first began working withlarge-scale scientific datasets.

    Chapter 1. Introduction

    When I was a graduate student, I had a serious problem: a brand-new dataset,made up of millions of data points collected painstakingly over a full week on anationally recognized plasma research device, that contained values that weremuch too small.

    About 40 orders of magnitude too small.

    My advisor and I huddled in his office, in front of the shiny new G5 Power Macthat ran our visualization suite, and tried to figure out what was wrong.The data had been acquired correctly from the machine. It looked like the original raw file from the experimentsdigitizer was fine. I had written a (very large) script in the IDLprogramming language on my Thinkpad laptop to turn the raw data into files thevisualization tool could use. This in-house format was simplicity itself:just a short fixed-width header and then a binary dump of thefloating-point data. Even so, I spent another hour or so writing a program toverify and plot the files on my laptop. They were fine. And yet, whenloaded into the visualizer, all the data that looked so beautiful in IDLturned into a featureless, unstructured mush of values all around 10-41.

    Next page
    Light

    Font size:

    Reset

    Interval:

    Bookmark:

    Make

    Similar books «Python and HDF5»

    Look at similar books to Python and HDF5. We have selected literature similar in name and meaning in the hope of providing readers with more options to find new, interesting, not yet read works.


    Reviews about «Python and HDF5»

    Discussion, reviews of the book Python and HDF5 and just readers' own opinions. Leave your comments, write what you think about the work, its meaning or the main characters. Specify what exactly you liked and what you didn't like, and why you think so.