[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Help me explain --demux

From: Ole Tange
Subject: Re: Help me explain --demux
Date: Sat, 16 Feb 2019 00:30:43 +0100

On Fri, Feb 15, 2019 at 9:29 PM Achim Gratz <address@hidden> wrote:
> Ole Tange writes:
> > I have implemented --demux.
> >
> > I need help explaining what this is and how to use it.
> >
> > --demultiplex or --demux splits out a stream of records and give each
> > record to a process based on the hash value of a column.
> The database community would call this "sharding".

True. Technically it is even closer to sharding than to demultiplexing.

I will rename --demux to --shard. And explain the column is the shard key.

At least the DB people might understand that, and others should be
able to look that up.

Good input. Thanks.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]