- 博客(2)
- 资源 (1)
- 收藏
- 关注
RSS订阅转载 spark-sql与elasticsearch整合&测试
1. 前置条件 spark是1.4.1版本elasticsearch是1.7版本java是1.7版本 2. 依赖jar包 需要使用elasticsearch-hadoop 下载地址：http://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-hadoop/2.2.0-m1 3. 配置
2016-07-06 19:01:15
357
转载 Spark使用总结与分享[http://www.cnblogs.com/bourneli/p/4394271.html]
背景 使用spark开发已有几个月。相比于python/hive，scala/spark学习门槛较高。尤其记得刚开时，举步维艰，进展十分缓慢。不过谢天谢地，这段苦涩（bi）的日子过去了。忆苦思甜，为了避免项目组的其他同学走弯路，决定总结和梳理spark的使用经验。 Spark基础 基石RDD spark的核心是RDD（
2016-06-13 14:23:55
941
HPFP-Miner A Novel Parallel Frequent Itemset Mining Algorithm
并行频繁相机挖掘算法 Frequent itemset mining is a fundamental and
essential issue in data mining field and can be used in many
data mining tasks. Most of these mining tasks require multiple
passes over the database and if the database size is large,
which is usually the case, scalable high performance solutions
involving multiple processors are required. In this paper, we
present a novel parallel frequent itemset mining algorithm
which is called HPFP-Miner. The proposed algorithm is based
on FP-Growth and introduces little communication overheads
by efficiently partitioning the list of frequent elements list over
processors. The results of experiment show that HPFP-Miner
has good scalability and performanc
2019-02-08
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人