1. 程式人生 > >flink的入門案例之wordcount

flink的入門案例之wordcount

這是依賴

<dependency>

<groupId>org.apache.flink</groupId>

<artifactId>flink-java</artifactId>

<version>1.5.0</version>

</dependency>

<dependency>

<groupId>org.apache.flink</groupId>

<artifactId>flink-streaming-java_2.11</artifactId>

<version>

1.5.0</version>

</dependency>

<dependency>

<groupId>org.apache.flink</groupId>

<artifactId>flink-clients_2.11</artifactId>

<version>1.5.0</version>

</dependency>

 這個是1.5版本的依賴..

然後是我們的程式碼

public class FlinkWordCount {

         publicstatic void main(String[] args) throws Exception {

       final ExecutionEnvironment env =ExecutionEnvironment.getExecutionEnvironment();

       DataSet<String> text = env.fromElements(

           "hadoop hive?",

           "think hadoop hive sqoop hbase spark flink?");

        DataSet<Tuple2<String,Integer>> wordCounts = text

           .flatMap(new LineSplitter())

           .groupBy(0)

           .sum(1);

       wordCounts.print();

    }

   public static class LineSplitter implements FlatMapFunction<String,Tuple2<String, Integer>> {

       @Override

       public void flatMap(String line, Collector<Tuple2<String,Integer>> out) {

           for (String word : line.split("\\W+")) {

                out.collect(newTuple2<String, Integer>(word, 1));

           }

       }

}

 


執行結果,,可以在節點根據命令提交,

也可以在UI介面提交jar.的包,,在submit的需要指定程式的主類