parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Help me explain --demux


From: Ole Tange
Subject: Re: Help me explain --demux
Date: Sat, 16 Feb 2019 00:30:43 +0100

On Fri, Feb 15, 2019 at 9:29 PM Achim Gratz <address@hidden> wrote:
>
> Ole Tange writes:
> > I have implemented --demux.
> >
> > I need help explaining what this is and how to use it.
> >
> > --demultiplex or --demux splits out a stream of records and give each
> > record to a process based on the hash value of a column.
>
> The database community would call this "sharding".

True. Technically it is even closer to sharding than to demultiplexing.

I will rename --demux to --shard. And explain the column is the shard key.

At least the DB people might understand that, and others should be
able to look that up.

Good input. Thanks.


/Ole



reply via email to

[Prev in Thread] Current Thread [Next in Thread]