Change Details

To make it easier to perform both ad-hoc and daily analytics, it would be good to have Cirrus server-side logs in HDFS. Bob Flagg would be a great person to do this since he has an analytics background and it would provide an introduction to both our analytics infrastructure and our search infrastructure. Tasks: 1. Sit down with Oliver and work out what fields we want to log; 2. Create a streaming format in Cirrus that outputs logs containing these fields in a way HDFS can consume; 3. Work with Ottomata to integrate this stream into HDFS's input

To make it easier to perform both ad-hoc and daily analytics, it would be good to have Cirrus server-side logs in HDFS. Bob Flagg would be a great person to do this since he has an analytics background and it would provide an introduction to both our analytics infrastructure and our search infrastructure. Tasks: 1. Sit down with Oliver and work out what fields we want to log; 2. Create a streaming format in Cirrus that outputs logs containing these fields in a way HDFS can consume; 3. Work with Ottomata to integrate this stream into HDFS's input Definition of "done" for this task: * Cirrus logs are available in Hadoop.

To make it easier to perform both ad-hoc and daily analytics, it would be good to have Cirrus server-side logs in HDFS. Bob Flagg would be a great person to do this since he has an analytics background and it would provide an introduction to both our analytics infrastructure and our search infrastructure. Tasks: 1. Sit down with Oliver and work out what fields we want to log; 2. Create a streaming format in Cirrus that outputs logs containing these fields in a way HDFS can consume; 3. Work with Ottomata to integrate this stream into HDFS's input Definition of "done" for this task: * Cirrus logs are available in Hadoop.