12 Applied Sciences

学生身份

我要认证

2019-11-17改过昵称

等级
TA的排名 204

flink社区提问没有人回答是怎么回事?

最近发现自己在mailing list中的提问没有人回答很苦恼怎么办?通过git blame xxx.md 发现文档是某个作者写的然后去[1]中看下该作者是否在mailing list中,如果该行内容的作者并不在mailing list中,那么你即使把邮件发给社区(也就是所谓的user@flink.apache.org)也没用了,因为作者看不到。所以,如果你发邮件给社区后,没有人回答你,你可以看下相关问题的作者是否在社区,如果不在,那么即使你再怎么等,也永远不会有回复了。.

2020-10-25 11:28:09

markdown支持的脑图工具

最近发现markdown支持脑图,所以打算调研下有哪些工具工具 备注信息 MarkRemap 貌似只能mac使用,网上信息非常少  MarkMap 是个网站 MarkMap-lib 是个git repository需要node.js的加持才能生成脑图 simple-mind-map 支持gitbook ...

2020-10-24 15:49:30

toAppendStream doesn‘t support consuming update changes which is produced by node GroupAggregate

Exception in thread "main" org.apache.flink.table.api.TableException: toAppendStream doesn't support consuming update changes which is produced by node GroupAggregate(groupBy=[amount, product, user], select=[amount, product, user])解决方案: tEnv....

2020-10-21 16:31:12

xxxx is not found in PojoType<Order, fields = [amount: Integer, product: String, user: Long]>

代码如下:Table orders = tEnv.from("Orders");Table result = orders.select($("product"), $("user"),$("amount").as("total"));tEnv.toAppendStream(result, Order.class).print();env.execute();完整报错如下:Exception in thread "main" org.apache.flink.table.api.Tab

2020-10-21 11:42:45

may indicate binary incompatibility. Expected 160 from C header, got 152 from PyObject

完整代码是:https://enjoyment.cool/2020/02/27/Three-Min-Series-How-to-create-UDF-in-PyFlink-1-10/碰到这么个问题: File "dev/.conda/envs/3.5/lib/python3.5/site-packages/apache_beam/runners/common.pxd", line 85, in init pyflink.fn_execution.fast_operations...

2020-10-20 21:25:02

SQL validation failed.Column ‘content‘ not found in any table

代码如下:Exception in thread "main" org.apache.flink.table.api.ValidationException: SQL validation failed. From line 1, column 8 to line 1, column 14: Column 'content' not found in any table完整报错如下:Exception in thread "main" org.apache.flink.table.api.

2020-10-20 21:21:12

createTemporaryView is deprecated

写了这么一些代码: DataStream<Order> orderA = env.fromCollection(Arrays.asList( new Order(1L, "beer", 3), new Order(3L, "rubber", 2), new Order(1L, "diaper", 4) )); intellij提示:creat...

2020-10-20 18:54:06

flink的table/sql api的多种写法汇总

这个记载是为了方便转化网络中各种资料的写法,所以每个阶段都收集了各种写法.并且进行了运行验证.步骤 写法 初始化环境 StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); StreamTableEnvironment tEnv = StreamTableEnvironment.create(env); 建立表格 下面3种写法完全等效.

2020-10-20 17:23:08

Cannot resolve field [product], input field list:[user, EXPR$0]

flink的故障table api使用案例如下如下:Table counts = Orders .groupBy($("user")) .select($("user"),$("product"),$("amount").sum().as("cnt"));Exception in thread "main" org.apache.flink.table.api.ValidationException: Cannot resolve fie...

2020-10-19 23:26:13

flink sql的datastream与dataset初始化代码汇总

flink sql 数据类型 初始化代码汇总 dataset ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();BatchTableEnvironment tableEnv = BatchTableEnvironment.create(env); datastream StreamExecutionEnvironment en...

2020-10-19 16:41:39

flink的Table类型的变量两种输出的形式

是否需要env.execute() 数据处理类型 具体代码 需要 流处理 Table table = tEnv.sqlQuery("select test() as a,test(a) as b, test(a,b,c) as c from t");DataStream<Row> res = tEnv.toAppendStream(table, Row.class);res.print();env.execute(); 不需要...

2020-10-18 19:12:24

Cannot resolve method addSource

原始代碼如下:ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();BatchTableEnvironment tableEnv = BatchTableEnvironment.create(env);DataStream<Row> source = env.addSource(new RichSourceFunction<Row>() ...Intellij提示:Can

2020-10-18 18:49:59

Cannot resolve method ‘getTableEnvironment(org.apache.flink.api.java.ExecutionEnvironment)‘

代码如下:public class UDTF{ public static void main(String[] args) throws Exception { ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); BatchTableEnvironment tableEnv = TableEnvironment.getTableEnviron

2020-10-18 16:05:53

数据湖三种方案的流行度调查

所属的公司 百度搜索数量 谷歌搜索数量 Apache Hudi Uber 891,000 68,200 Delta Lake Databricks 749,000 185,000,000 Apache Iceberg Netflix 302,000 1,960,000 所以从目前来看,主要是Apache Hudi和Delta Lake...

2020-10-18 15:53:49

Cannot resolve field [content], input field list:[contents].

碰到这么个报错:Exception in thread "main" org.apache.flink.table.api.ValidationException: Cannot resolve field [content], input field list:[contents]. at org.apache.flink.table.expressions.resolver.rules.ReferenceResolverRule$ExpressionResolverVisitor.failFor

2020-10-18 12:38:36

No new data sinks have been defined since the last execution.

完整报错如下:Exception in thread "main" java.lang.RuntimeException: No new data sinks have been defined since the last execution. The last execution refers to the latest call to 'execute()', 'count()', 'collect()', or 'print()'. at org.apache.flink.api.jav...

2020-10-18 11:00:09

Python笔记-Collection中Iterable、Iterator和Generator的区别

IterableIterable是Python集合的一种,导入方式为from collections import Iterable。Iterable对象都具有__iter__()方法,可以被for循环。例如list,tuple,dictionary,string都是Iterable。IteratorIterable也是Python集合的一种,导入方式为from collections import Iterator。Iterator是Iterable的子类,Iterator对象都具有__.

2020-10-17 23:25:56

Flink的基于ValueState的状态机

最近浏览ververica[1]的时候,看到了这么个例子[3]首先复习下状态机的概念Qn+1=F(Qn)Q_{n+1}=F(Q_{n})Qn+1​=F(Qn​)[3]这个例子是在用ValuState来解释Flink的State管理,并且还在[2]中提到While this example is much simpler and more manual than what the CEP library supports, it illustrates the use of event proce

2020-10-17 22:38:02

The configured Task Off-Heap Memory 0 bytes is less than the least required Python worker Memory 79

碰到这么个报错:WARNING: An illegal reflective access operation has occurredWARNING: Illegal reflective access by org.apache.flink.api.java.ClosureCleaner (file:/home/appleyuchi/anaconda3/lib/python3.6/site-packages/pyflink/lib/flink-dist_2.11-1.11.2.jar) to f

2020-10-17 18:04:58

‘StreamTableDescriptor‘ object has no attribute ‘register_table_sink‘

原始代码长这样:t = t_env.from_elements([(1, 2, 'Welcome'), (2, 3, 'To'), (3, 4, 'PyFlink')], ['a', 'b', 'c'])t_env.connect(FileSystem().path(sink_path))\ .with_format(OldCsv() .field_delimiter(',') .field("add1", DataTypes.BIGINT())

2020-10-17 17:05:08

查看更多

勋章 我的勋章
  • 领英
    领英
    绑定领英第三方账户获取
  • GitHub
    GitHub
    绑定GitHub第三方账户获取
  • 签到新秀
    签到新秀
    累计签到获取,不积跬步,无以至千里,继续坚持!
  • 技术圈认证
    技术圈认证
    用户完成年度认证,即可获得
  • 持之以恒
    持之以恒
    授予每个自然月内发布4篇或4篇以上原创或翻译IT博文的用户。不积跬步无以至千里,不积小流无以成江海,程序人生的精彩需要坚持不懈地积累!
  • 1024勋章
    1024勋章
    #1024程序员节#活动勋章,当日发布原创博客即可获得
  • 1024超级勋章
    1024超级勋章
    授予原创文章总数达到1024篇的博主,感谢你对CSDN社区的贡献,CSDN与你一起成长。
  • 勤写标兵Lv4
    勤写标兵Lv4
    授予每个自然周发布9篇以上(包括9篇)原创IT博文的用户。本勋章将于次周周三上午根据用户上周的博文发布情况由系统自动颁发。