超哥_cn-CSDN博客

原创 wget 下载网站所有文件

wget -r -np -nH-e robots=off--cut-dirs=3 http://hostname/aaa/bbb/ccc/ddd/

2021-01-18 13:29:44 507

原创 k8s 强制删除命名空间namespace

kubectl get namespace cattle-system -o json \ | tr -d "\n" | sed "s/\"finalizers\": \[[^]]\+\]/\"finalizers\": []/" \ | kubectl replace --raw /api/v1/namespaces/cattle-system/finalize -f -

2021-01-15 20:28:23 1125

原创 kafka-topics.sh java.rmi.server.ExportException: Port already in use: 5555

unsetJMX_PORT;kafka-topics.sh--create--zookeeperzookeeper:2181/kafka--replication-factor1--partitions1--topictestkafka-topics.sh 前面加 unsetJMX_PORT;

2021-01-14 23:07:35 1619 1

原创 k8s 1.20 nfs 创建pvc pending waiting for a volume to be created selfLink was empty

persistentvolume-controller waiting for a volume to be created, either by external provisionerselfLink was empty, can't make reference修改/etc/kubernetes/manifests/kube-apiserver.yaml文件添加添加- --feature-gates=RemoveSelfLink=false[root@master ~]...

2021-01-13 23:16:42 4079 2

原创 debian docker 国内源解决速度慢问题

RUNmv/etc/apt/sources.list/etc/apt/sources.list.bak&&\echodebhttp://mirrors.aliyun.com/debian/stretchmainnon-freecontrib>/etc/apt/sources.list&&\echodeb-srchttp://mirrors.aliyun.com/debian/stretchmainnon...

2020-12-24 16:01:26 2324 1

原创 MacOS flutter doctor Android Studio (version 4.1) Flutter plugin not installed 问题解决

flutter doctor 失败✗ Flutter plugin not installed; this adds Flutter specific functionality.✗ Dart plugin not installed; this adds Dart specific functionality.第一步：目录建立软连接Android Studio (version 4.1)：Flutter plugin not installed and Dart plugin not ins

2020-11-26 08:59:56 1417 1

原创 vmware workstation 16 安装macos big sur 11.0.1 (20B29)

运行autounlocker前，注意首先逐一手动关闭vm相关的5个win10服务项，然后用管理员权限运行不必再使用vm10虚拟机硬件配置，直接使用最新vm 16硬件配置+macos11.1操作系统选项，来新建虚拟机或修改兼容性安装教程：https://www.bilibili.com/read/cv7038972镜像下载地址：https://sysin.org/article/macOS-Big-Sur-boot-iso/...

2020-11-17 21:53:01 9205 1

转载解决VMware WorkStation中安装Mac OS不能更改屏幕分辨率的问题

VMware中安装Mac OS后屏幕分辨率只有1024x768，即便在安装vmtools后也不能调整分辨率，其实vmtools提供了更改分辨率的命令行工具在终端中执行： 1 /Library/Application\Support/VMware\Tools/vmware-resolutionSet19201080 后分辨率直接就更改。注意：1、显卡分配显存要够，128M是比较ok了2、显示器设置最高分辨率要达到设定的分辨率...

2020-11-17 21:49:24 6482 3

原创 docker-compose 部署 dolphin scheduler

version:'3'services:master:image:rockxsj/dolphinschedulercontainer_name:dolphinschedulerports:-"8888:8888"environment:-TZ=Asia/Shanghai-DATABASE_HOST=xxx.com-DATABASE_PORT=5432-D...

2020-09-30 00:28:43 1306

转载 Docker：MySQL连接慢问题解决

问题描述：由于MySQL是使用Docker容器搭建起来的，在今天的数据库连接中，发现比平时的连接速度变慢了很多，每次连接大概延迟了10秒左右。排查过程1、服务器资源查看系统的CPU、网络等负载，无异常。2、数据库连接池一开始怀疑是连接数过多导致，登入MySQL后发现连接数有近200，于是kill掉一部分，发现还是连接缓慢。排除连接数导致缓慢。3.、网络问题在ping服务器的时候并没有出现数据包延迟、丢包现象。网络问题排除。4、MySQL DNS解析查阅了相关资料，觉得可

2020-09-29 17:46:02 1739

原创 nacos dubbo grpc 注册错误 dom name can only have these characters: 0-9a-zA-Z-._:

修改nacos源码com.alibaba.nacos.naming.core.Service.javaprivate static final String SERVICE_NAME_SYNTAX = "[0-9a-zA-Z@\\.:_:$-]+";

2020-08-31 12:56:56 1133

原创 windows 7 64位中使用32位的mysql odbc 193 1918

要用 C:\Windows\SysWOW64 里的 odbcad32.exe 进行配置

2020-07-12 20:07:15 263

原创 elasticsearch docker-compose 端口和发布地址修改

version:'3'services:es01:image:hub.redblue-ai.com/elasticsearch:7.5.2hostname:es01environment:-node.name=es01-cluster.name=es-docker-cluster-http.port=9200-transport.tcp.port=9300-netw...

2020-05-11 00:20:58 1316

原创 tensorflow2.0 word2vec=》item2vec 【gensim】比 tensorflow 快

from __future__ import absolute_import, division, print_function, unicode_literalsimport ioimport matplotlib.pyplot as pltimport numpy as npimport pandas as pdimport tensorflow as tfimport...

2020-04-29 00:39:56 572

原创 item2vec model 参考word2vec 【tensorflow】有点慢

from __future__ import absolute_import, division, print_function, unicode_literalsimport ioimport matplotlib.pyplot as pltimport numpy as npimport pandas as pdimport tensorflow as tfimport tens...

2020-04-29 00:38:06 551

原创 not serializable result: org.apache.kafka.clients.consumer.ConsumerRecord

解决方法创建SparkContext时设置一个属性set("spark.serializer","org.apache.spark.serializer.KryoSerializer")Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Ta...

2020-04-18 02:00:50 878

原创 truffle Cannot destructure property body of ‘undefined’ or 'null’

换版本解决的npm -g i [email protected]转载https://blog.csdn.net/qq_35434814/article/details/104416068

2020-04-14 15:24:31 240

原创 docker-compose 连接mysql8 数据库使用localhost 引发的错误 DruidDataSource : create connection SQLException

解决方案：不要使用localhost或者127.0.0.1，使用内网的ip，就解决了-SPRING_DATASOURCE_URL=jdbc:mysql://172.17.0.4:3306/davinci0.3?useUnicode=true&characterEncoding=UTF[Druid-ConnectionPool-Create-1066270324] com.a...

2020-04-05 15:46:09 969 1

原创 spark-TestAggregateMessages-聚合消息

import java.io.PrintWriterimport grizzled.slf4j.Loggerimport org.apache.spark.graphx._import org.apache.spark.graphx.util.GraphGeneratorsimport org.apache.spark.sql.SparkSessionimport org.redbl...

2020-03-10 20:47:25 247

原创 spark-TestDijkstraPath-有权值的最短路径

import java.io.PrintWriterimport grizzled.slf4j.Loggerimport org.apache.spark.graphx._import org.apache.spark.graphx.util.GraphGeneratorsimport org.apache.spark.sql.SparkSession// 有权值的最短路径obj...

2020-03-10 20:45:55 271

原创 neo4j docker部署连接遇到的坑 WebSocket connection failure. Due to security constraints in your web browser

连接地址修改成bolt//开头就可以了bolt://neo4j.redblue-ai.com:7687https://blog.csdn.net/yangfengling1023/article/details/89413232?depth_1-utm_source=distribute.pc_relevant.none-task&utm_source=distribu...

2020-03-08 13:19:14 5197 3

原创 windows运行spark-shell.cmd 问题 NOCLASSFOUND

一、spark-shell.cmd 启动出错 NoClassDefFoundError在load-spark-env.cmd 文件中增加以下设置环境变量内容，hadoop后面先在系统环境变量里设置，或者直接使用路径@echo offrem ################### SET ENV ##################rem set SPARK_MASTER_IP...

2020-03-07 21:01:00 1438 1

原创 Flink和Kafka scala版本

使用DataStream来消费Kafka。下面Schema类很重要，实现对消息的序列化和反序列化KafkaSerializationSchema<Quotes>, KafkaDeserializationSchema<Quotes>import java.util.Propertiesimport com.redblue.entity.Quotesi...

2020-03-06 23:51:39 2094 1

原创 Flink和Kafka

使用DataStream来消费Kafka。下面Schema类很重要，实现对消息的序列化和反序列化KafkaSerializationSchema<Quotes>, KafkaDeserializationSchema<Quotes>import com.redblue.entity.Quotes;import com.redblue.kafka....

2020-03-06 23:47:16 696

原创 MobaXterm terminal 显示中文

termina 右键change terminal settingswindowtranslationremote character set：选择Use font encodinghttps://blog.csdn.net/pyufftj/article/details/80467223

2020-02-22 15:58:40 38135 2

原创 sparkstreaming线程数小于2时出错！

[Stage 0:> (0 + 1) / 1][Stage 10:> (0 + 1) / 1]20/02/11 11:32:55 WARN RandomBlockReplicationPolicy: Expecting 1 replicas with only 0 peer/s.20/02/11 11:32:55 WA...

2020-02-11 11:35:31 632

原创 Caused by: java.lang.ClassCastException: cannot assign instance of scala.collection.immutable.List$S

Caused by: java.lang.ClassCastException: cannot assign instance of scala.collection.immutable.List$SerializationProxy to field org.apache.spark.rdd.RDD.org$apache$spark$rdd$RDD$$dependencies_ of type ...

2020-02-03 22:40:43 4814 4

原创 k8s 部署dubbo

docker pull chenchuxin/dubbo-admindocker tag chenchuxin/dubbo-admin hub.redblue-ai.com/dubbo-admincat <<'END' > dubbo.yamlapiVersion: v1kind: Servicemetadata: name: dubbo labels:...

2020-01-26 12:15:42 747

原创 ceph docker 部署使用raw格式的镜像作为磁盘

https://blog.csdn.net/qq_33932782/article/details/54896619https://blog.csdn.net/klyhuntermax/article/details/51907856https://ceph.com/planet/%E5%9F%BA%E4%BA%8Edocker%E9%83%A8%E7%BD%B2ceph%E4%BB%A5...

2020-01-25 22:22:14 830

原创 docker mysql 连接10038 network restart 带来的问题

docker mysql 连接10038 network restart 带来的问题网络修改和重启影响docker ，需要重新启动docker

2020-01-19 18:31:07 933

原创 k8s 部署consul集群

cat <<'END' > consul.yaml---apiVersion: v1kind: Servicemetadata: name: consul labels: name: consulspec: type: NodePort ports: - name: http port: 8500 ...

2020-01-19 12:22:29 1582

原创 sentinel dashboard ---docker和k8s部署

sentinel-dashboard下载页面：https://github.com/alibaba/Sentinel/releases-----------------------------Dockerfile:FROM openjdk:8-jdk-alpineVOLUME /tmpADD sentinel-dashboard-1.7.1.jar sentinel-dashboard...

2020-01-17 18:18:50 3283

原创 k8s 部署nacos，mysql数据库自行搭建和初始化nacos的sql

cat <<'END' > nacos.yaml---apiVersion: v1kind: Servicemetadata: name: nacos labels: app: nacos annotations: service.alpha.kubernetes.io/tolerate-unready-endpoints: "true"...

2020-01-17 08:46:37 3500

原创 demo -hystrix 缓存请求合并流量限制断路器

https://github.com/wangchao1980/demo-hystrix

2020-01-16 18:49:55 123

原创 Resilience4j circuitbreaker: # 断路器 retry: # 失败重试 ratelimiter: # 限流 bulkhead: # 隔离

https://github.com/wangchao1980/demo-resilience4j

2020-01-15 23:25:08 340

原创 springboot2.2.2 + mybatisplus + shardingsphere 分片主从路由 yml

https://github.com/wangchao1980/demo-shardingsphere/tree/master有空再写说明有问题请联系qq：23326199

2020-01-11 20:53:16 353

原创可以用describe查看label根据label进行设置selector

## 可以用describe查看label根据label进行设置selector## selector:## app: mysql## statefulset.kubernetes.io/pod-name: mysql-0##

2020-01-11 18:36:07 335

原创 k8s rbd 挂载目录修改容器pv 方法 rbd map

################rbd挂载pvc和文件修改，容器文件修改###############kubectl get pvkubectl describe pv pvc-0daded5f-ce10-4144-bc36-94e4747d9e79#找到对应的RBDImage: kubernetes-dynamic-pvc-53c292c3-26c5-11ea-a6a2-e2da...

2019-12-29 12:12:07 1212

原创 k8s安装kafka

https://www.cnblogs.com/xuliang666/p/11847270.htmlhttps://mp.csdn.net/postedit/103728827参考上两篇博文# 制作zookeeper镜像mkdir zookeepercd zookeeperdocker pull guglecontainers/kubernetes-zookeeper:1.0-...

2019-12-27 12:38:26 1116 1

原创 k8s安装mysql

#mysql_root_passwordecho -n 'test.123' |base64#mysql_userecho -n 'admin' |base64#mysql_user_passwordecho -n 'test.123' |base64# 密码cat <<END > mysql-secret.yamlapiVersion: v1kind:...

2019-12-27 12:21:12 1579