groupBy

Class: matlab.compiler.mlspark.RDD
Package: matlab.compiler.mlspark

Return an RDD of grouped items

expand all in page

Syntax

result = groupBy(obj,func,numPartitions)

Description

result = groupBy(obj,func,numPartitions) groups the elements of obj according a user-specified criteria denoted by func. numPartitions specifies the number of partitions to create in the resulting RDD.

Input Arguments

expand all

An input RDD, specified as a RDD object.

Function performing grouping, specified as a function handle.

Data Types: function_handle

Number of partitions to create, specified as a scalar value.

Data Types: double

Output Arguments

expand all

A pipelined RDD containing grouped elements of the input RDD, returned as a RDD object.

Examples

expand all

Groups the elements of an RDD according a user-specified criteria.

%% Connect to Spark
sparkProp = containers.Map({'spark.executor.cores'}, {'1'});
conf = matlab.compiler.mlspark.SparkConf('AppName','myApp', ...
                        'Master','local[1]','SparkProperties',sparkProp);
sc = matlab.compiler.mlspark.SparkContext(conf);

%% groupBy
inRDD = sc.parallelize({1,2,3,4,5});
outRDD = inRDD.groupBy(@(x)(mod(x,2))).collect(); % {{0,{2,4}},{1,{1,3,5}

See Also

|

Introduced in R2016b

MATLAB Compiler Documentation

Support