BackWPupによるWordPressのバックアップとRcloneによるNASとの同期

ページ : 1 2 3

ロリポップサーバのWebDAVと相性悪いSynology NAS

BackWPupプラグインのバックアップファイルはWebサーバ上に保存されているので、このままではサーバ障害時に活用することが出来ません。Webサーバとは異なる場所に保管するべく、日頃愛用しているSynology NAS DS212Jへの同期転送を考えてみます。

SynologyのNASにはさまざまなオンラインストレージサービスとファイル同期することの出来る、Cloud Syncというアプリが用意されています。当初、WebサーバのWebDAVを同期先としてこのCloud Syncを使おうと試行してみましたが、

図15.Cloud Sync プロバイダ選択

図16.Cloud Sync アカウント設定

接続されてルートディレクトリは表示されるのですが、そこからサブディレクトリへ行こうとするとかたまります。別途、Ubuntu 18.04のNautilusでもWebDAVを試してみますが、またしてもサブディレクトリへの移動で「301 Moved Permanently」になってしまいます。

図17.Cloud Sync サブディレクトリへ入れず

Windows 10のエクスプローラからは問題無く使えるので、ロリポップサーバのWebDAVが全く使えない、と言うわけでもなく、むしろLinux系とのWebDAVはあまり想定していないのかも知れません。

RcloneをSynology NASにインストール

ロリポップのライトプランではsshも使えないので、WebDAV以外でファイル転送として残されているプロトコルはFTPのみ。但し、Synology Cloud SyncはFTPをサポートしていないので、両者をFTPで同期転送する仕組みとして今回使ってみるのがこのRcloneです。

Rcloneはファイル同期やバックアップとして馴染みのrsyncを、各社オンラインストレージやクラウドなど様々な相手に拡張したような印象で、LinuxやWindowsで動作します。インストールもプラットフォームを自動識別するインストールバッチが公式より用意されているので、それを以下の要領で実行するのみ。Synology NAS DS212Jのターミナル上で、インストールバッチを実行してインストールしました。

$ curl https://rclone.org/install.sh | sudo bash
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  4491  100  4491    0     0   3622      0  0:00:01  0:00:01 --:--:--  3624
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100    15  100    15    0     0     13      0  0:00:01  0:00:01 --:--:--    13
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 12.6M  100 12.6M    0     0  1420k      0  0:00:09  0:00:09 --:--:-- 2323k

Everything is Ok
Folders: 1
Files: 5
Size:       39265765
Compressed: 13308709mandb not found. The rclone man docs will not be installed.
rclone v1.55.1 has successfully installed.
Now run "rclone config" for setup. Check https://rclone.org/docs/ for more details.

$ rclone version
rclone v1.55.1
- os/type: linux
- os/arch: arm
- go/version: go1.16.3
- go/linking: static
- go/tags: none

$ curl https://rclone.org/install.sh | sudo bash

% Total % Received % Xferd Average Speed Time Time Time Current

Dload Upload Total Spent Left Speed

100 4491 100 4491 0 0 3622 0 0:00:01 0:00:01 --:--:-- 3624

% Total % Received % Xferd Average Speed Time Time Time Current

Dload Upload Total Spent Left Speed

100 15 100 15 0 0 13 0 0:00:01 0:00:01 --:--:-- 13

% Total % Received % Xferd Average Speed Time Time Time Current

Dload Upload Total Spent Left Speed

100 12.6M 100 12.6M 0 0 1420k 0 0:00:09 0:00:09 --:--:-- 2323k

Everything is Ok

Folders: 1

Files: 5

Size: 39265765

Compressed: 13308709mandb not found. The rclone man docs will not be installed.

rclone v1.55.1 has successfully installed.

Now run "rclone config" for setup. Check https://rclone.org/docs/ for more details.

$ rclone version

rclone v1.55.1

- os/type: linux

- os/arch: arm

- go/version: go1.16.3

- go/linking: static

- go/tags: none

インストールが済んだらまず、リモート接続先の登録を行います（登録せずにrclone実行時に全てオプションに指定する方法も可能ですが、ログイン情報も平文でオプションに列記することになるので非推奨）。

$ rclone config
2021/06/27 22:58:32 NOTICE: Config file "/var/services/homes/######/.config/rclone/rclone.conf" not found - using defaults
No remotes found - make a new one
n) New remote
s) Set configuration password
q) Quit config
n/s/q> n
name> Lolipop
Type of storage to configure.
Enter a string value. Press Enter for the default ("").
Choose a number from below, or type in your own value
 1 / 1Fichier
   \ "fichier"
 2 / Alias for an existing remote
   \ "alias"
 3 / Amazon Drive
   \ "amazon cloud drive"
 4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Minio, and Tencent COS
   \ "s3"
 5 / Backblaze B2
   \ "b2"
 6 / Box
   \ "box"
 7 / Cache a remote
   \ "cache"
 8 / Citrix Sharefile
   \ "sharefile"
 9 / Compress a remote
   \ "compress"
10 / Dropbox
   \ "dropbox"
11 / Encrypt/Decrypt a remote
   \ "crypt"
12 / Enterprise File Fabric
   \ "filefabric"
13 / FTP Connection
   \ "ftp"
14 / Google Cloud Storage (this is not Google Drive)
   \ "google cloud storage"
15 / Google Drive
   \ "drive"
16 / Google Photos
   \ "google photos"
17 / Hadoop distributed file system
   \ "hdfs"
18 / Hubic
   \ "hubic"
19 / In memory object storage system.
   \ "memory"
20 / Jottacloud
   \ "jottacloud"
21 / Koofr
   \ "koofr"
22 / Local Disk
   \ "local"
23 / Mail.ru Cloud
   \ "mailru"
24 / Mega
   \ "mega"
25 / Microsoft Azure Blob Storage
   \ "azureblob"
26 / Microsoft OneDrive
   \ "onedrive"
27 / OpenDrive
   \ "opendrive"
28 / OpenStack Swift (Rackspace Cloud Files, Memset Memstore, OVH)
   \ "swift"
29 / Pcloud
   \ "pcloud"
30 / Put.io
   \ "putio"
31 / QingCloud Object Storage
   \ "qingstor"
32 / SSH/SFTP Connection
   \ "sftp"
33 / Sugarsync
   \ "sugarsync"
34 / Tardigrade Decentralized Cloud Storage
   \ "tardigrade"
35 / Transparently chunk/split large files
   \ "chunker"
36 / Union merges the contents of several upstream fs
   \ "union"
37 / Webdav
   \ "webdav"
38 / Yandex Disk
   \ "yandex"
39 / Zoho
   \ "zoho"
40 / http Connection
   \ "http"
41 / premiumize.me
   \ "premiumizeme"
42 / seafile
   \ "seafile"
Storage>13
** See help for ftp backend at: https://rclone.org/ftp/ **

FTP host to connect to
Enter a string value. Press Enter for the default ("").
Choose a number from below, or type in your own value
 1 / Connect to ftp.example.com
   \ "ftp.example.com"
host> ftp.lolipop.jp
FTP username, leave blank for current username, admin
Enter a string value. Press Enter for the default ("").
user> #################
FTP port, leave blank to use default (21)
Enter a string value. Press Enter for the default ("").
port> 
FTP password
y) Yes type in my own password
g) Generate random password
y/g> y     
Enter the password:
password:
Confirm the password:
password:
Use Implicit FTPS (FTP over TLS)
When using implicit FTP over TLS the client connects using TLS
right from the start which breaks compatibility with
non-TLS-aware servers. This is usually served over port 990 rather
than port 21. Cannot be used in combination with explicit FTP.
Enter a boolean value (true or false). Press Enter for the default ("false").
tls> 
Use Explicit FTPS (FTP over TLS)
When using explicit FTP over TLS the client explicitly requests
security from the server in order to upgrade a plain text connection
to an encrypted one. Cannot be used in combination with implicit FTP.
Enter a boolean value (true or false). Press Enter for the default ("false").
explicit_tls> true
Edit advanced config? (y/n)
y) Yes
n) No (default)
y/n>n
Remote config
--------------------
[Lolipop]
type = ftp
host = ftp.lolipop.jp
user = #################
pass = *** ENCRYPTED ***
explicit_tls = true
--------------------
y) Yes this is OK (default)
e) Edit this remote
d) Delete this remote
y/e/d> y
Current remotes:
Name                 Type
====                 ====
Lolipop              ftp

e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> q

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

$ rclone config

2021/06/27 22:58:32 NOTICE: Config file "/var/services/homes/######/.config/rclone/rclone.conf" not found - using defaults

No remotes found - make a new one

n) New remote

s) Set configuration password

q) Quit config

n/s/q> n

name> Lolipop

Type of storage to configure.

Enter a string value. Press Enter for the default ("").

Choose a number from below, or type in your own value

1 / 1Fichier

\ "fichier"

2 / Alias for an existing remote

\ "alias"

3 / Amazon Drive

\ "amazon cloud drive"

4 / Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Minio, and Tencent COS

\ "s3"

5 / Backblaze B2

\ "b2"

6 / Box

\ "box"

7 / Cache a remote

\ "cache"

8 / Citrix Sharefile

\ "sharefile"

9 / Compress a remote

\ "compress"

10 / Dropbox

\ "dropbox"

11 / Encrypt/Decrypt a remote

\ "crypt"

12 / Enterprise File Fabric

\ "filefabric"

13 / FTP Connection

\ "ftp"

14 / Google Cloud Storage (this is not Google Drive)

\ "google cloud storage"

15 / Google Drive

\ "drive"

16 / Google Photos

\ "google photos"

17 / Hadoop distributed file system

\ "hdfs"

18 / Hubic

\ "hubic"

19 / In memory object storage system.

\ "memory"

20 / Jottacloud

\ "jottacloud"

21 / Koofr

\ "koofr"

22 / Local Disk

\ "local"

23 / Mail.ru Cloud

\ "mailru"

24 / Mega

\ "mega"

25 / Microsoft Azure Blob Storage

\ "azureblob"

26 / Microsoft OneDrive

\ "onedrive"

27 / OpenDrive

\ "opendrive"

28 / OpenStack Swift (Rackspace Cloud Files, Memset Memstore, OVH)

\ "swift"

29 / Pcloud

\ "pcloud"

30 / Put.io

\ "putio"

31 / QingCloud Object Storage

\ "qingstor"

32 / SSH/SFTP Connection

\ "sftp"

33 / Sugarsync

\ "sugarsync"

34 / Tardigrade Decentralized Cloud Storage

\ "tardigrade"

35 / Transparently chunk/split large files

\ "chunker"

36 / Union merges the contents of several upstream fs

\ "union"

37 / Webdav

\ "webdav"

38 / Yandex Disk

\ "yandex"

39 / Zoho

\ "zoho"

40 / http Connection

\ "http"

41 / premiumize.me

\ "premiumizeme"

42 / seafile

\ "seafile"

Storage>13

** See help for ftp backend at: https://rclone.org/ftp/ **

FTP host to connect to

Enter a string value. Press Enter for the default ("").

Choose a number from below, or type in your own value

1 / Connect to ftp.example.com

\ "ftp.example.com"

host> ftp.lolipop.jp

FTP username, leave blank for current username, admin

Enter a string value. Press Enter for the default ("").

user> #################

FTP port, leave blank to use default (21)

Enter a string value. Press Enter for the default ("").

port>

FTP password

y) Yes type in my own password

g) Generate random password

y/g> y

Enter the password:

password:

Confirm the password:

password:

Use Implicit FTPS (FTP over TLS)

When using implicit FTP over TLS the client connects using TLS

right from the start which breaks compatibility with

non-TLS-aware servers. This is usually served over port 990 rather

than port 21. Cannot be used in combination with explicit FTP.

Enter a boolean value (true or false). Press Enter for the default ("false").

tls>

Use Explicit FTPS (FTP over TLS)

When using explicit FTP over TLS the client explicitly requests

security from the server in order to upgrade a plain text connection

to an encrypted one. Cannot be used in combination with implicit FTP.

Enter a boolean value (true or false). Press Enter for the default ("false").

explicit_tls> true

Edit advanced config? (y/n)

y) Yes

n) No (default)

y/n>n

Remote config

--------------------

[Lolipop]

type = ftp

host = ftp.lolipop.jp

user = #################

pass = *** ENCRYPTED ***

explicit_tls = true

--------------------

y) Yes this is OK (default)

e) Edit this remote

d) Delete this remote

y/e/d> y

Current remotes:

Name Type

==== ====

Lolipop ftp

e) Edit existing remote

n) New remote

d) Delete remote

r) Rename remote

c) Copy remote

s) Set configuration password

q) Quit config

e/n/d/r/c/s/q> q

2023.05.24追記）
FTPサーバ側の挙動が変わったのか、rcloneが接続しようとすると、次のメッセージで異常終了するようになりました。

Failed to create file system for "Lolipop:": NewFs: failed to make FTP connection to "ftp.lolipop.jp:21": I can't deal with you (proxy error for user)

1
2
3

Failed to create file system for "Lolipop:": NewFs:
failed to make FTP connection to "ftp.lolipop.jp:21":
I can't deal with you (proxy error for user)

デバッグオプションを付けて確認してみると、 AUTH TLS が怪しそう。

admin@nas06:~$ rclone lsf Lolipop: -vv --dump bodies 2023/05/24 12:04:41 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "lsf" "Lolipop:" "-vv" "--dump" "bodies"] 2023/05/24 12:04:41 DEBUG : Creating backend with remote "Lolipop:" 2023/05/24 12:04:41 DEBUG : ftp://ftp.lolipop.jp:21: Connecting to FTP server 2023/05/24 12:04:41 DEBUG : FTP Rx: "220 Lolipop FTP server ready" 2023/05/24 12:04:41 DEBUG : FTP Tx: "AUTH TLS" 2023/05/24 12:04:41 DEBUG : FTP Rx: "234 AUTH command ok. Expecting TLS Negotiation." 2023/05/24 12:04:41 DEBUG : FTP Tx: "USER #################" 2023/05/24 12:04:42 DEBUG : FTP Rx: "530 I can't deal with you (proxy error for user)" 2023/05/24 12:04:42 DEBUG : FTP Tx: "QUIT" 2023/05/24 12:04:42 Failed to create file system for "Lolipop:": NewFs: failed to make FTP connection to "ftp.lolipop.jp:21": I can't deal with you (proxy error for user)

1
2
3
4
5
6
7
8
9
10
11

admin@nas06:~$ rclone lsf Lolipop: -vv --dump bodies
2023/05/24 12:04:41 DEBUG : rclone: Version "v1.55.1" starting with parameters ["rclone" "lsf" "Lolipop:" "-vv" "--dump" "bodies"]
2023/05/24 12:04:41 DEBUG : Creating backend with remote "Lolipop:"
2023/05/24 12:04:41 DEBUG : ftp://ftp.lolipop.jp:21: Connecting to FTP server
2023/05/24 12:04:41 DEBUG : FTP Rx: "220 Lolipop FTP server ready"
2023/05/24 12:04:41 DEBUG : FTP Tx: "AUTH TLS"
2023/05/24 12:04:41 DEBUG : FTP Rx: "234 AUTH command ok. Expecting TLS Negotiation."
2023/05/24 12:04:41 DEBUG : FTP Tx: "USER #################"
2023/05/24 12:04:42 DEBUG : FTP Rx: "530 I can't deal with you (proxy error for user)"
2023/05/24 12:04:42 DEBUG : FTP Tx: "QUIT"
2023/05/24 12:04:42 Failed to create file system for "Lolipop:": NewFs: failed to make FTP connection to "ftp.lolipop.jp:21": I can't deal with you (proxy error for user)

色々試した結果、当初は true にしていた explicit_tls を false に変えて、正常動作に復帰しました。

-------------------- [Lolipop] type = ftp host = ftp.lolipop.jp user = ################# pass = *** ENCRYPTED *** explicit_tls = false tls = false no_check_certificate = false --------------------

1
2
3
4
5
6
7
8
9
10

--------------------
[Lolipop]
type = ftp
host = ftp.lolipop.jp
user = #################
pass = *** ENCRYPTED ***
explicit_tls = false
tls = false
no_check_certificate = false
--------------------

追記ここまで。

設定中に促されたRcloneをFTPでの使い方と注意事項について確認してみると、同期に際しハッシュによるファイル比較はサポートしておらず、ファイルサイズで判断するとのことですが、今回のような用途には支障は無いでしょう。

rclone.org

FTP

https://rclone.org/ftp/

Rclone docs for FTP backend

Rcloneを試行して手動同期

Rcloneのリモート接続先の設定を終えたので、公式サイトのドキュメントを確認しながら、リモート接続先に対していくつかコマンドを発行してみます。まず、BackWPupがWebサーバ上に作成したバックアップ・アーカイブを収めたディレクトリの一覧を要求してみます。

$ rclone lsf Lolipop:/blog/wp-content/uploads/backwpup-######-backups/
.donotbackup
.htaccess
20210623_231839_DM5Q33NF01.tar.gz
20210623_232320_OM5Q33PK02.tar.gz
20210624_111544_CE5Q33J503.tar.gz
20210625_020709_V45Q33M603.tar.gz
20210626_020548_DI5Q33NC03.tar.gz
20210627_021631_JM5Q33M203.tar.gz
20210628_023340_U45Q33NP03.tar.gz
index.php

$ rclone lsf Lolipop:/blog/wp-content/uploads/backwpup-######-backups/

.donotbackup

.htaccess

20210623_231839_DM5Q33NF01.tar.gz

20210623_232320_OM5Q33PK02.tar.gz

20210624_111544_CE5Q33J503.tar.gz

20210625_020709_V45Q33M603.tar.gz

20210626_020548_DI5Q33NC03.tar.gz

20210627_021631_JM5Q33M203.tar.gz

20210628_023340_U45Q33NP03.tar.gz

index.php

ls 関連はこちらのページに詳細があります。 ls -l のようなことをするのは、 lsl で良さそうです。

$ rclone lsl Lolipop:/blog/wp-content/uploads/backwpup-######-backups/
      139 2021-06-23 23:18:39.000000000 .donotbackup
      221 2021-06-23 23:18:39.000000000 .htaccess
621130703 2021-06-23 23:19:21.000000000 20210623_231839_DM5Q33NF01.tar.gz
  1999681 2021-06-23 23:23:21.000000000 20210623_232320_OM5Q33PK02.tar.gz
623691378 2021-06-24 11:16:14.000000000 20210624_111544_CE5Q33J503.tar.gz
626419653 2021-06-25 02:07:39.000000000 20210625_020709_V45Q33M603.tar.gz
628619188 2021-06-26 02:06:20.000000000 20210626_020548_DI5Q33NC03.tar.gz
628625353 2021-06-27 02:17:04.000000000 20210627_021631_JM5Q33M203.tar.gz
628618595 2021-06-28 02:34:19.000000000 20210628_023340_U45Q33NP03.tar.gz
628616521 2021-06-29 02:17:50.000000000 20210629_021718_3E5Q33MJ03.tar.gz
       99 2021-06-23 23:18:39.000000000 index.php

$ rclone lsl Lolipop:/blog/wp-content/uploads/backwpup-######-backups/

139 2021-06-23 23:18:39.000000000 .donotbackup

221 2021-06-23 23:18:39.000000000 .htaccess

621130703 2021-06-23 23:19:21.000000000 20210623_231839_DM5Q33NF01.tar.gz

1999681 2021-06-23 23:23:21.000000000 20210623_232320_OM5Q33PK02.tar.gz

623691378 2021-06-24 11:16:14.000000000 20210624_111544_CE5Q33J503.tar.gz

626419653 2021-06-25 02:07:39.000000000 20210625_020709_V45Q33M603.tar.gz

628619188 2021-06-26 02:06:20.000000000 20210626_020548_DI5Q33NC03.tar.gz

628625353 2021-06-27 02:17:04.000000000 20210627_021631_JM5Q33M203.tar.gz

628618595 2021-06-28 02:34:19.000000000 20210628_023340_U45Q33NP03.tar.gz

628616521 2021-06-29 02:17:50.000000000 20210629_021718_3E5Q33MJ03.tar.gz

99 2021-06-23 23:18:39.000000000 index.php

バックアップ・アーカイブのみを抽出した一覧にするには、フィルタリング機能を使います。

$ rclone lsl --include="*.tar.gz" Lolipop:/blog/wp-content/uploads/backwpup-######-backups/
621130703 2021-06-23 23:19:21.000000000 20210623_231839_DM5Q33NF01.tar.gz
  1999681 2021-06-23 23:23:21.000000000 20210623_232320_OM5Q33PK02.tar.gz
623691378 2021-06-24 11:16:14.000000000 20210624_111544_CE5Q33J503.tar.gz
626419653 2021-06-25 02:07:39.000000000 20210625_020709_V45Q33M603.tar.gz
628619188 2021-06-26 02:06:20.000000000 20210626_020548_DI5Q33NC03.tar.gz
628625353 2021-06-27 02:17:04.000000000 20210627_021631_JM5Q33M203.tar.gz
628618595 2021-06-28 02:34:19.000000000 20210628_023340_U45Q33NP03.tar.gz
628616521 2021-06-29 02:17:50.000000000 20210629_021718_3E5Q33MJ03.tar.gz

$ rclone lsl --include="*.tar.gz" Lolipop:/blog/wp-content/uploads/backwpup-######-backups/