Skip to content

Commit

Permalink
完善feaplat文档
Browse files Browse the repository at this point in the history
  • Loading branch information
Boris-code committed Mar 27, 2024
1 parent 2d81d63 commit f508e6d
Show file tree
Hide file tree
Showing 2 changed files with 39 additions and 24 deletions.
37 changes: 14 additions & 23 deletions docs/feapder_platform/feaplat.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,8 @@

## 功能概览

暂时不支持 苹果电脑的Apple芯片

### 1. 项目管理

添加/编辑项目
Expand Down Expand Up @@ -136,7 +138,12 @@ systemctl start docker
# 如果你的 Docker 主机有多个网卡,拥有多个 IP,必须使用 --advertise-addr 指定 IP
docker swarm init --advertise-addr 192.168.99.100

### 3. 安装docker-compose
### 3. 安装docker-compose(非必须)
一般安装完docker后,会自带 docker compose。可先输入下面的命令验证是否有改环境,若有则不需要安装
``` shell
docker compose
```
若无`docker compose`命令,则按照下面的安装

```shell
sudo curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
Expand All @@ -147,6 +154,9 @@ sudo chmod +x /usr/local/bin/docker-compose
sudo curl -L "https://get.daocloud.io/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
```
安装后输入`docker-compose`验证是否成功

注:`docker-compose``docker compose` 两种命令用法一样,是一个东西,只不过不同版本的docker可能叫法不一

### 4. 部署feaplat爬虫管理系统
#### 预备项
Expand Down Expand Up @@ -175,7 +185,7 @@ git clone -b develop https://gitee.com/Boris-code/feaplat.git
```shell
cd feaplat
docker compose up -d
如果报错,尝试用下面命令运行
或者
docker-compose up -d
```

Expand Down Expand Up @@ -250,28 +260,9 @@ docker node ls
docker swarm leave
```

## 拉取私有项目
## 使用

拉取私有项目需在git仓库里添加如下公钥

```
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCd/k/tjbcMislEunjtYQNXxz5tgEDc/fSvuLHBNUX4PtfmMQ07TuUX2XJIIzLRPaqv3nsMn3+QZrV0xQd545FG1Cq83JJB98ATTW7k5Q0eaWXkvThdFeG5+n85KeVV2W4BpdHHNZ5h9RxBUmVZPpAZacdC6OUSBYTyCblPfX9DvjOk+KfwAZVwpJSkv4YduwoR3DNfXrmK5P+wrYW9z/VHUf0hcfWEnsrrHktCKgohZn9Fe8uS3B5wTNd9GgVrLGRk85ag+CChoqg80DjgFt/IhzMCArqwLyMn7rGG4Iu2Ie0TcdMc0TlRxoBhqrfKkN83cfQ3gDf41tZwp67uM9ZN [email protected]
```

或在系统设置页面配置您的SSH私钥,然后在git仓库里添加您的公钥,例如:
![](http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/10/19/16346353514967.jpg)

注意,公私钥加密方式为RSA,其他的可能会有问题

生成RSA公私钥方式如下:
```shell
ssh-keygen -t rsa -C "备注" -f 生成路径/文件名
```
如:
`ssh-keygen -t rsa -C "feaplat" -f id_rsa`
然后一路回车,不要输密码
![](http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/11/17/16371210640228.jpg)
最终生成 `id_rsa``id_rsa.pub` 文件,复制`id_rsa.pub`文件内容到git仓库,复制`id_rsa`文件内容到feaplat爬虫管理系统
[FEAPLAT使用说明](feapder_platform/usage)

## 自定义爬虫镜像

Expand Down
26 changes: 25 additions & 1 deletion docs/feapder_platform/usage.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@

1. 准备项目,项目结构如下:
![](http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/10/16/16343707944750.jpg)
2. 压缩后上传:
2. 压缩后上传:(推荐使用 `feapder zip` 命令压缩)
![](http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/10/16/16343709590040.jpg)
- 工作路径:上传的项目会被放到docker里的根目录下(跟你本机项目路径没关系),然后解压运行。因`feapder_demo.zip`解压后为`feapder_demo`,所以工作路径配置`/feapder_demo`
- 本项目没依赖,可以不配置`requirements.txt`
Expand All @@ -44,6 +44,30 @@
![](http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/10/16/16343720862217.jpg)

可以看到已经运行完毕

## git方式拉取私有项目

拉取私有项目需在git仓库里添加如下公钥

```
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCd/k/tjbcMislEunjtYQNXxz5tgEDc/fSvuLHBNUX4PtfmMQ07TuUX2XJIIzLRPaqv3nsMn3+QZrV0xQd545FG1Cq83JJB98ATTW7k5Q0eaWXkvThdFeG5+n85KeVV2W4BpdHHNZ5h9RxBUmVZPpAZacdC6OUSBYTyCblPfX9DvjOk+KfwAZVwpJSkv4YduwoR3DNfXrmK5P+wrYW9z/VHUf0hcfWEnsrrHktCKgohZn9Fe8uS3B5wTNd9GgVrLGRk85ag+CChoqg80DjgFt/IhzMCArqwLyMn7rGG4Iu2Ie0TcdMc0TlRxoBhqrfKkN83cfQ3gDf41tZwp67uM9ZN [email protected]
```

或在系统设置页面配置您的SSH私钥,然后在git仓库里添加您的公钥,例如:
![](http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/10/19/16346353514967.jpg)

注意,公私钥加密方式为RSA,其他的可能会有问题

生成RSA公私钥方式如下:
```shell
ssh-keygen -t rsa -C "备注" -f 生成路径/文件名
```
如:
`ssh-keygen -t rsa -C "feaplat" -f id_rsa`
然后一路回车,不要输密码
![](http://markdown-media.oss-cn-beijing.aliyuncs.com/2021/11/17/16371210640228.jpg)
最终生成 `id_rsa``id_rsa.pub` 文件,复制`id_rsa.pub`文件内容到git仓库,复制`id_rsa`文件内容到feaplat爬虫管理系统



## 爬虫监控
Expand Down

0 comments on commit f508e6d

Please sign in to comment.