sparklyr.nested 0.0.4
- Replaced now-defunct
dplyr::select_vars calls with
tidyselect::vars_select
- Support (optionally) using
listviewer::reactjson to
view schemas
sparklyr.nested 0.0.3
- Initial release
- To support read schemas,
array_type,
binary_type, boolean_type,
byte_type, character_type,
date_type, double_type,
float_type, integer_type,
long_type, map_type,
numeric_type, string_type,
struct_field, struct_type, and
timestamp_type are provided. These will return java
references needed for schema definition.
sdf_select enables access to nested fields (within
maps, structs, and arrays of structs).
sdf_explode will convert arrays of structs to simple
structs by duplicating rows over each unique array entry. Also works on
map types if is_map=TRUE.
sdf_nest and sdf_unnest are similar to the
similarly named tidyr functions. sdf_unnest
essentially chains sdf_explode and sdf_select
with some schema inspection.
sdf_schema_json and sdf_schema_viewer
support schema interrogation