partitioned
partitioned (loop), contextual keyword
The contextual keyword partitioned modifies the behavior of the loop blok. It partitions a table into a shortlist of independent segments.
table T = extend.range(123)
T.N2 = 0
loop 10 partitioned table T
T.N2 = T.N ^ 2
show table "" with T.N, T.N2
This syntax is intended for the parallelization of the Envision flow when processing very large tables, typically beyond 1 billion lines.
partitioned (write), contextual keyword
The contextual keyword partitioned modifies the behavior of the write block: several files can be written at once.
table Products = with
[| as Product, as Color, as Price |]
[| "shirt", "white", 10.50 |]
[| "pants", "blue", 15.00 |]
[| "hat", "white", 5.25 |]
Products.Path = "/sample/products-\{Products.Color}.csv"
write Products partitioned as Products.Path with
Product = Products.Product
Color = Products.Color
Price = Products.Price
The script above can be rewritten with the introduction of a table that reifies the list of files to be written.
table Products = with
[| as Product, as Color, as Price |]
[| "shirt", "white", 10.50 |]
[| "pants", "blue", 15.00 |]
[| "hat", "white", 5.25 |]
table P[path] = by "/sample/products-\{Products.Color}.csv"
write Products partitioned as path with
Product = Products.Product
Color = Products.Color
Price = Products.Price
The maximum number of files that are allowed to be produced by a single write .. partitioned block is 100. Any attempt to produce more files will fail at runtime.