Posts

Showing posts from August, 2018

Read pubsub message publish time using Apache beam with Google dataflow

This is a simple message to read publishTime of a message when reading using PubSub IO.

@ProcessElement
    public void processElement(DoFn<String, MessageDTO>.ProcessContext c) throws Exception {

        MessageDTO dataPacket = c.element();

        Instant time = c.timestamp();

        dto.setPubsubTimestamp(time.toDateTime());

        c.output(dto);
       }