Tuesday, November 19, 2013

Scala Notes

1. A function calling async function should return a future too.

def foo (b: B) : Future[A] {
    val c = aync {
       ...
    }

2. access a future:

 for {
      s <- c
   } yield {
      ...
   }
}

3. change a list of future to future of list
Future.sequence(x)

4. wrap anything with Future:
sync(None)

Thursday, November 14, 2013

Test udf


 java -cp ./insights-etl-0.7.6.jar:~/insights/lib/*:/usr/lib/hive/lib/* com.klout.perk.GnipTupleUDTF

Friday, November 1, 2013

Hive Mapside Join Configuration

Disable mapside join
set hive.auto.convert.join=false;
Other configuration : go to https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties
search mapside join