Stream¶

class asdf.Stream(shape, dtype, strides=None)[source]¶

Bases: NDArrayType

Used to put a streamed array into the tree.

Examples

Save a double-precision array with 1024 columns, one row at a time:

>>> from asdf import AsdfFile, Stream
>>> import numpy as np
>>> ff = AsdfFile()
>>> ff.tree['streamed'] = Stream([1024], np.float64)
>>> with open('test.asdf', 'wb') as fd:
...     ff.write_to(fd)
...     for i in range(200):
...         nbytes = fd.write(
...                      np.array([i] * 1024, np.float64).tobytes())

Attributes Summary

`block`
`dtype`
`handle_dynamic_subclasses`
`has_required_modules`
`name`
`organization`
`requires`
`shape`
`standard`
`supported_versions`
`types`
`validators`
`version`
`yaml_tag`

Methods Summary

`assert_allclose`(old, new)
`assert_equal`(old, new)
`copy_to_new_asdf`(node, asdffile)
`from_tree`(data, ctx)	Converts basic types representing YAML trees into custom types.
`from_tree_tagged`(tree, ctx)	Converts from tagged tree into custom type.
`get_actual_shape`(shape, strides, dtype, ...)	Get the actual shape of an array, by computing it against the block_size if it contains a `*`.
`incompatible_version`(version)	Indicates if given version is known to be incompatible with this type.
`make_yaml_tag`(name[, versioned])	Given the name of a type, returns a string representing its YAML tag.
`names`()	Returns the name(s) represented by this tag type as a list.
`reserve_blocks`(data, ctx)
`tag_base`()	Returns the base of the YAML tag for types represented by this class.
`to_tree`(data, ctx)	Converts instances of custom types into YAML representations.
`to_tree_tagged`(node, ctx)	Converts instances of custom types into tagged objects.

Attributes Documentation

block¶

dtype¶

handle_dynamic_subclasses = False¶

has_required_modules = True¶

name = None¶

organization = 'stsci.edu'¶

requires = []¶

shape¶

standard = 'asdf'¶

supported_versions = [AsdfVersion('1.0.0'), AsdfVersion('1.1.0')]¶

types = []¶

validators = {'datatype': <function validate_datatype>, 'max_ndim': <function validate_max_ndim>, 'ndim': <function validate_ndim>}¶

version = AsdfVersion('1.0.0')¶

yaml_tag = 'tag:stsci.edu:asdf/core/ndarray-1.0.0'¶

Methods Documentation

classmethod assert_allclose(old, new)¶

classmethod assert_equal(old, new)¶

classmethod copy_to_new_asdf(node, asdffile)¶

classmethod from_tree(data, ctx)[source]¶

Converts basic types representing YAML trees into custom types.

This method should be overridden by custom extension classes in order to define how custom types are deserialized from the YAML representation back into their original types. Typically the method will return an instance of the original custom type. It is also permitted to return a generator, which yields a partially constructed result, then completes construction once the generator is drained. This is useful when constructing objects that contain reference cycles.

This method is called as part of the process of reading an ASDF file in order to construct an asdf.AsdfFile object. Whenever a YAML subtree is encountered that has a tag that corresponds to the yaml_tag property of this class, this method will be used to deserialize that tree back into an instance of the original custom type.

Parameters:

treeobject representing YAML tree: An instance of a basic Python type (possibly nested) that corresponds to a YAML subtree.
ctxasdf.AsdfFile: An instance of the asdf.AsdfFile object that is being constructed.

Returns:

An instance of the custom type represented by this extension class,
or a generator that yields that instance.

classmethod from_tree_tagged(tree, ctx)¶

Converts from tagged tree into custom type.

It is more common for extension classes to override from_tree instead of this method. This method should only be overridden if it is necessary to access the _tag property of the Tagged object directly.

Parameters:

treeasdf.tagged.Tagged object representing YAML tree
ctxasdf.AsdfFile: An instance of the asdf.AsdfFile object that is being constructed.

Returns:

An instance of the custom type represented by this extension class.

get_actual_shape(shape, strides, dtype, block_size)¶: Get the actual shape of an array, by computing it against the block_size if it contains a *.

classmethod incompatible_version(version)¶

Indicates if given version is known to be incompatible with this type.

If this tag class explicitly identifies compatible versions then this checks whether a given version is compatible or not (see supported_versions). Otherwise, all versions are assumed to be compatible.

Child classes can override this method to affect how version compatibility for this type is determined.

Parameters:

versionstr or AsdfVersion: The version to test for compatibility.

classmethod make_yaml_tag(name, versioned=True)¶

Given the name of a type, returns a string representing its YAML tag.

Parameters:

namestr: The name of the type. In most cases this will correspond to the name attribute of the tag type. However, it is passed as a parameter since some tag types represent multiple custom types.
versionedbool: If True, the tag will be versioned. Otherwise, a YAML tag without a version will be returned.

Returns:

str representing the YAML tag

classmethod names()¶

Returns the name(s) represented by this tag type as a list.

While some tag types represent only a single custom type, others represent multiple types. In the latter case, the name attribute of the extension is actually a list, not simply a string. This method normalizes the value of name by returning a list in all cases.

Returns:

list of names represented by this tag type

classmethod reserve_blocks(data, ctx)[source]¶

classmethod tag_base()¶

Returns the base of the YAML tag for types represented by this class.

This method returns the portion of the tag that represents the standard and the organization of any type represented by this class.

Returns:

str representing the base of the YAML tag

classmethod to_tree(data, ctx)[source]¶

Converts instances of custom types into YAML representations.

This method should be overridden by custom extension classes in order to define how custom types are serialized into YAML. The method must return a single Python object corresponding to one of the basic YAML types (dict, list, str, or number). However, the types can be nested and combined in order to represent more complex custom types.

This method is called as part of the process of writing an asdf.AsdfFile object. Whenever a custom type (or a subclass of that type) that is listed in the types attribute of this class is encountered, this method will be used to serialize that type.

The name to_tree refers to the act of converting a custom type into part of a YAML object tree.

Parameters:

nodeobject: Instance of a custom type to be serialized. Will be an instance (or an instance of a subclass) of one of the types listed in the types attribute of this class.
ctxasdf.AsdfFile: An instance of the asdf.AsdfFile object that is being written out.

Returns:

A basic YAML type (dict, list, str, int, float, or
complex) representing the properties of the custom type to be
serialized. These types can be nested in order to represent more
complex custom types.

classmethod to_tree_tagged(node, ctx)¶

Converts instances of custom types into tagged objects.

It is more common for custom tag types to override to_tree instead of this method. This method should be overridden if it is necessary to modify the YAML tag that will be used to tag this object.

Parameters:

nodeobject: Instance of a custom type to be serialized. Will be an instance (or an instance of a subclass) of one of the types listed in the types attribute of this class.
ctxasdf.AsdfFile: An instance of the asdf.AsdfFile object that is being written out.

Returns:

An instance of asdf.tagged.Tagged.

Navigation

Stream¶