Test to compare plotting speed on XFS vs EXT4 with -t largefile4

Support Testing
1

Abstract

File system related plotting speed comparison test. Aimed to compare plotting on XFS vs EXT4 with -t largefile4 flag.
Duration time: 26 hours 53 minutes 43 seconds
Two farmers of the same size were run simultaneously on the same hardware on different filesystems.
Despite minor fluctuations, the completion rate of farmer (f3) running EXT4 -m 0 -t largefile4 was slightly higher than that of farmer (f2) running on XFS at the corresponding time intervals.
On randomly taken shorter time segments from the full log, the results were the same.

Hardware Setup

AMD Ryzen 9 5950X 16-Core Processor, not overclocked.
128 GB ECC RAM
1 Gb/s
OS Linux 22.04

$lsblk -o NAME,FSTYPE,LABEL,MOUNTPOINT,SIZE,MODEL

NAME        FSTYPE LABEL MOUNTPOINT   SIZE MODEL
sda                                 894.3G Micron_5200_MTFD
└─sda1      ext4         /          894.3G 
nvme0n1                               3.5T SAMSUNG MZQL23T8HCLS-00A07
└─nvme0n1p1 xfs    f2    /mnt/f2      3.5T    Allocated space: 3.4 TiB (3.8 TB)
nvme1n1                               3.5T SAMSUNG MZQL23T8HCLS-00A07
└─nvme1n1p1 ext4   f3    /mnt/f3      3.5T    Allocated space: 3.4 TiB (3.8 TB)

Software setup

Only Node exporter and newly installed Linux (22.04) were ran.
The subspace-farmer and node services were configured with their default options, except for the number of allowed connections:

          --listen-on /ip4/0.0.0.0/tcp/30533 \
          --out-connections 1000 \
          --pending-out-connections 1000 \
          path=/mnt/f2,size=3770G \
          path=/mnt/f3,size=3770G

disk_farm_index=0 is Farmer “f2”, XFS with internal journal, mounted as : ‘…defaults,swalloc,largeio 0 0’
disk_farm_index=1 is Farmer “f3”, EXT4 with ‘-m 0’ and ‘-T largefile4’, mounted as ‘…defaults 0 1’

Data

Note: The analysis used periodic samples at approximately equal intervals from the entire output of the command sudo Journalctl -o cat -u subspace-farmer -n 1000 -f.
Obviously time points do not affect the test results. Though using randomly taken shorter periods of time of the full log the same results are achieved.

2024-02-21T10:22:13.368076Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (0.00% complete) sector_index=0
2024-02-21T10:22:13.368110Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (0.00% complete) sector_index=0

2024-02-21T11:15:07.548151Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (0.28% complete) sector_index=10
2024-02-21T11:16:01.162395Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (0.28% complete) sector_index=10

2024-02-21T14:41:00.715129Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.36% complete) sector_index=48
2024-02-21T14:45:43.447656Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.42% complete) sector_index=50

2024-02-21T15:13:22.939676Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.53% complete) sector_index=54
2024-02-21T15:17:55.375621Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.56% complete) sector_index=55

2024-02-21T15:23:17.592304Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.56% complete) sector_index=55
2024-02-21T15:28:27.366404Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.61% complete) sector_index=57

2024-02-21T16:00:00.912543Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.78% complete) sector_index=63
2024-02-21T16:04:45.371554Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.78% complete) sector_index=63

2024-02-21T16:05:14.626893Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.81% complete) sector_index=64
2024-02-21T16:09:58.442880Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (1.81% complete) sector_index=64

2024-02-21T17:02:08.823732Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.10% complete) sector_index=74
2024-02-21T17:02:58.230722Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.12% complete) sector_index=75

2024-02-21T18:04:43.756551Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.44% complete) sector_index=86
2024-02-21T18:05:44.413184Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.46% complete) sector_index=87

2024-02-21T18:46:35.774614Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.66% complete) sector_index=94
2024-02-21T18:47:20.098198Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.69% complete) sector_index=95

2024-02-21T19:19:00.000635Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.86% complete) sector_index=101
2024-02-21T19:24:26.881914Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.86% complete) sector_index=101

2024-02-21T20:21:41.255594Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (3.20% complete) sector_index=113
2024-02-21T20:22:39.487208Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (3.17% complete) sector_index=112

2024-02-21T21:25:20.535514Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (3.51% complete) sector_index=124
2024-02-21T21:28:40.616108Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (3.57% complete) sector_index=126

2024-02-21T22:40:24.763216Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (3.97% complete) sector_index=140
2024-02-21T22:43:23.531810Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (3.94% complete) sector_index=139

2024-02-22T00:02:40.467485Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (4.42% complete) sector_index=156
2024-02-22T00:06:58.551190Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (4.39% complete) sector_index=155

2024-02-22T01:25:42.648581Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (4.82% complete) sector_index=170
2024-02-22T01:30:33.959566Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (4.90% complete) sector_index=173

2024-02-22T02:33:51.633889Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (5.18% complete) sector_index=183
2024-02-22T02:37:44.664403Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (5.27% complete) sector_index=186

2024-02-22T03:52:40.303005Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (5.61% complete) sector_index=198
2024-02-22T03:55:28.935880Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (5.69% complete) sector_index=201

2024-02-22T05:33:51.684956Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (6.23% complete) sector_index=220
2024-02-22T05:37:53.780003Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (6.18% complete) sector_index=218

2024-02-22T07:12:23.308449Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (6.69% complete) sector_index=236
2024-02-22T07:17:27.449051Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (6.80% complete) sector_index=240

2024-02-22T08:57:28.466318Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (7.25% complete) sector_index=256
2024-02-22T09:01:13.553850Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (7.37% complete) sector_index=260

2024-02-22T10:45:03.933999Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (7.93% complete) sector_index=280
2024-02-22T10:47:45.255739Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (7.85% complete) sector_index=277

2024-02-22T12:24:02.394356Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (8.47% complete) sector_index=299
2024-02-22T12:27:47.481540Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (8.39% complete) sector_index=296

2024-02-22T13:15:26.762713Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (8.64% complete) sector_index=305
2024-02-22T13:15:56.667752Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (8.75% complete) sector_index=309

Observations:

disk_farm_index=0
Started plotting sector 0 at 2024-02-21T10:22:13.368110Z.
Reached 1.81% completion at 2024-02-21T16:05:14.626893Z.
Reached 2.86% completion at 2024-02-21T19:24:26.881914Z.
Reached 3.17% completion at 2024-02-21T20:22:39.487208Z.
Reached 3.94% completion at 2024-02-21T22:43:23.531810Z.
Reached 4.39% completion at 2024-02-22T00:06:58.551190Z.
Reached 4.90% completion at 2024-02-22T01:30:33.959566Z.
Reached 5.27% completion at 2024-02-22T02:37:44.664403Z.
Reached 5.69% completion at 2024-02-22T03:55:28.935880Z.
Reached 6.18% completion at 2024-02-22T05:37:53.780003Z.
Reached 6.69% completion at 2024-02-22T07:12:23.308449Z.
Reached 7.25% completion at 2024-02-22T08:57:28.466318Z.
Reached 7.85% completion at 2024-02-22T10:47:45.255739Z.
Reached 8.39% completion at 2024-02-22T12:27:47.481540Z.
Reached 8.64% completion at 2024-02-22T13:15:26.762713Z.

disk_farm_index=1
Started plotting sector 0 at 2024-02-21T10:22:13.368076Z.
Reached 1.56% completion at 2024-02-21T15:17:55.375621Z.
Reached 1.78% completion at 2024-02-21T16:00:00.912543Z.
Reached 2.12% completion at 2024-02-21T17:02:58.230722Z.
Reached 2.46% completion at 2024-02-21T18:05:44.413184Z.
Reached 2.69% completion at 2024-02-21T18:47:20.098198Z.
Reached 2.86% completion at 2024-02-21T19:19:00.000635Z.
Reached 3.20% completion at 2024-02-21T20:21:41.255594Z.
Reached 3.57% completion at 2024-02-21T21:28:40.616108Z.
Reached 3.97% completion at 2024-02-21T22:40:24.763216Z.
Reached 4.42% completion at 2024-02-22T00:02:40.467485Z.
Reached 4.90% completion at 2024-02-22T01:25:42.648581Z.
Reached 5.27% completion at 2024-02-22T02:33:51.633889Z.
Reached 5.69% completion at 2024-02-22T03:52:40.303005Z.
Reached 6.23% completion at 2024-02-22T05:33:51.684956Z.
Reached 6.80% completion at 2024-02-22T07:17:27.449051Z.
Reached 7.37% completion at 2024-02-22T09:01:13.553850Z.
Reached 7.93% completion at 2024-02-22T10:45:03.933999Z.
Reached 8.47% completion at 2024-02-22T12:24:02.394356Z.
Reached 8.75% completion at 2024-02-22T13:15:56.667752Z.

Disk Farm Index 0:
    Started plotting at 0.00% completion.
    Completed plotting up to 8.64%.
    Concluded at sector index 305.
Disk Farm Index 1:
    Also started plotting at 0.00% completion simultaneously with Index 0.
    Achieved plotting progress up to 8.75%.
    Concluded at sector index 309.

Conclusion:

EXT4 partition with -m 0 -T largefile4, mounted with default options demonstrates a relatively faster performance in completing the plotting process during the test duration, than that on XFS mounted as : ...defaults,swalloc,largeio 0 0.

2

Benchmark test on the same HW at the beginning and at the end of the plotting speed test.

sudo /home/subspace/.local/bin/subspace-farmer benchmark audit /mnt/f2 && sudo /home/subspace/.local/bin/subspace-farmer benchmark audit /mnt/f3

Benchmarking audit/plot/rayon
Benchmarking audit/plot/rayon: Warming up for 3.0000 s
Benchmarking audit/plot/rayon: Collecting 10 samples in estimated 5.0660 s (3520 iterations)
Benchmarking audit/plot/rayon: Analyzing
audit/plot/rayon        time:   [1.2899 ms 1.3476 ms 1.3982 ms]
                        thrpt:  [ 64061 GiB/s  66466 GiB/s  69439 GiB/s]
                 change:
                        time:   [+206.17% +224.06% +246.14%] (p = 0.00 < 0.05)
                        thrpt:  [-71.110% -69.141% -67.338%]
                        Performance has regressed.

Benchmarking audit/plot/rayon
Benchmarking audit/plot/rayon: Warming up for 3.0000 s
Benchmarking audit/plot/rayon: Collecting 10 samples in estimated 5.0136 s (3685 iterations)
Benchmarking audit/plot/rayon: Analyzing
audit/plot/rayon        time:   [1.3548 ms 1.4295 ms 1.4709 ms]
                        thrpt:  [ 61567 GiB/s  63347 GiB/s  66843 GiB/s]
                 change:
                        time:   [-3.3954% +5.3183% +14.108%] (p = 0.30 > 0.05)
                        thrpt:  [-12.363% -5.0497% +3.5148%]
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high mild

after 28 hours of running the test

sudo /home/subspace/.local/bin/subspace-farmer benchmark audit /mnt/f2 && sudo /home/subspace/.local/bin/subspace-farmer benchmark audit /mnt/f3

Benchmarking audit/plot/rayon
Benchmarking audit/plot/rayon: Warming up for 3.0000 s
Benchmarking audit/plot/rayon: Collecting 10 samples in estimated 5.1302 s (1320 iterations)
Benchmarking audit/plot/rayon: Analyzing
audit/plot/rayon        time:   [3.8069 ms 4.0068 ms 4.1359 ms]
                        thrpt:  [ 78061 GiB/s  80577 GiB/s  84807 GiB/s]
                 change:
                        time:   [+150.11% +173.72% +199.37%] (p = 0.00 < 0.05)
                        thrpt:  [-66.596% -63.466% -60.017%]
                        Performance has regressed.

Benchmarking audit/plot/rayon
Benchmarking audit/plot/rayon: Warming up for 3.0000 s
Benchmarking audit/plot/rayon: Collecting 10 samples in estimated 5.1419 s (1265 iterations)
Benchmarking audit/plot/rayon: Analyzing
audit/plot/rayon        time:   [3.7760 ms 3.8745 ms 3.9936 ms]
                        thrpt:  [ 82075 GiB/s  84598 GiB/s  86804 GiB/s]
                 change:
                        time:   [-5.7948% +0.4086% +7.0422%] (p = 0.91 > 0.05)
                        thrpt:  [-6.5789% -0.4069% +6.1513%]
                        No change in performance detected.

Overall Conclusion:

The initial benchmark tests showed variations in performance, with one test indicating a performance regression.
After 28 hours, further tests confirmed performance regression in one of the mount points (/mnt/f2 , which is XFS with, mounted as : ...defaults,swalloc,largeio.. ).
Continuous monitoring and periodic reevaluation may be necessary to address performance regressions and ensure optimal system performance.

3

Plotting speed difference will likely be just noise since disk is only used at the beginning of the plotting process to read locally cached pieces and at the end to write ~1G of data to disk. So file system generally doesn’t matter here.

While there is performance difference in auditing between file systems, it is either way doesn’t matter too much because, as you can see, auditing performance is well in excess of the realistically plotted space you’ll have on a single drive anyway.

The numbers are still interesting though, thanks!

4

for these two plots, this machine delivers just excellent performance

Plotting_speed_testing
Plotting_speed_testing1904×868 150 KB

5

Plotting speed test -m 0 vs -m 0 -t largefile4

here are two plots, 50 Gb each, on same hardware and on same fs (EXT4), but with different options:
disk_farm_index=0 - nvme0n1p1 ext4 f2 /mnt/f2 mounted with -m 0
disk_farm_index=1 - nvme1n1p1 ext4 f3 /mnt/f3 mounted with -m 0 -t largefile4
Test duration 3 hours, 49 minutes, and 24.42 seconds.

2024-02-22T20:37:50.671502Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (0.00% complete) sector_index=0
2024-02-22T20:37:50.671854Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (0.00% complete) sector_index=0
2024-02-22T20:44:26.955236Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.17% complete) sector_index=1
2024-02-22T20:44:38.979994Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (2.17% complete) sector_index=1
2024-02-22T20:49:47.255624Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (4.35% complete) sector_index=2
2024-02-22T20:50:49.862970Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (4.35% complete) sector_index=2
2024-02-22T20:54:56.646622Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (6.52% complete) sector_index=3
2024-02-22T20:56:34.782833Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (6.52% complete) sector_index=3
2024-02-22T21:00:29.796025Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (8.70% complete) sector_index=4
2024-02-22T21:02:05.953169Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (8.70% complete) sector_index=4
2024-02-22T21:05:47.892713Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (10.87% complete) sector_index=5
2024-02-22T21:07:43.375732Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (10.87% complete) sector_index=5
2024-02-22T21:11:17.109896Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (13.04% complete) sector_index=6
2024-02-22T21:13:12.306457Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (13.04% complete) sector_index=6
2024-02-22T21:16:45.339062Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (15.22% complete) sector_index=7
2024-02-22T21:18:53.798460Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (15.22% complete) sector_index=7
2024-02-22T21:22:09.245598Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (17.39% complete) sector_index=8
2024-02-22T21:24:20.392277Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (17.39% complete) sector_index=8
2024-02-22T21:27:46.062966Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (19.57% complete) sector_index=9
2024-02-22T21:29:43.320474Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (19.57% complete) sector_index=9
2024-02-22T21:33:16.036164Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (21.74% complete) sector_index=10
2024-02-22T21:35:28.176704Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (21.74% complete) sector_index=10
2024-02-22T21:38:42.205773Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (23.91% complete) sector_index=11
2024-02-22T21:40:50.117612Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (23.91% complete) sector_index=11
2024-02-22T21:44:07.754938Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (26.09% complete) sector_index=12
2024-02-22T21:46:15.911498Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (26.09% complete) sector_index=12
2024-02-22T21:49:18.651113Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (28.26% complete) sector_index=13
2024-02-22T21:52:27.714476Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (28.26% complete) sector_index=13
2024-02-22T21:54:58.218441Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (30.43% complete) sector_index=14
2024-02-22T21:58:05.614453Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (30.43% complete) sector_index=14
2024-02-22T22:00:37.185584Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (32.61% complete) sector_index=15
2024-02-22T22:03:44.182461Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (32.61% complete) sector_index=15
2024-02-22T22:06:15.978937Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (34.78% complete) sector_index=16
2024-02-22T22:09:22.503981Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (34.78% complete) sector_index=16
2024-02-22T22:11:53.405192Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (36.96% complete) sector_index=17
2024-02-22T22:14:59.982467Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (36.96% complete) sector_index=17
2024-02-22T22:17:32.061908Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (39.13% complete) sector_index=18
2024-02-22T22:20:31.294458Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (39.13% complete) sector_index=18
2024-02-22T22:23:11.565266Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (41.30% complete) sector_index=19
2024-02-22T22:26:05.290784Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (41.30% complete) sector_index=19
2024-02-22T22:28:47.416709Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (43.48% complete) sector_index=20
2024-02-22T22:31:46.931772Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (43.48% complete) sector_index=20
2024-02-22T22:34:25.446454Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (45.65% complete) sector_index=21
2024-02-22T22:37:28.170964Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (45.65% complete) sector_index=21
2024-02-22T22:40:01.583921Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (47.83% complete) sector_index=22
2024-02-22T22:42:50.234039Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (47.83% complete) sector_index=22
2024-02-22T22:46:33.878802Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (50.00% complete) sector_index=23
2024-02-22T22:47:57.454225Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (50.00% complete) sector_index=23
2024-02-22T22:51:52.162606Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (52.17% complete) sector_index=24
2024-02-22T22:53:53.308348Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (52.17% complete) sector_index=24
2024-02-22T22:57:27.659284Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (54.35% complete) sector_index=25
2024-02-22T22:59:32.984365Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (54.35% complete) sector_index=25
2024-02-22T23:03:01.229763Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (56.52% complete) sector_index=26
2024-02-22T23:05:09.185990Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (56.52% complete) sector_index=26
2024-02-22T23:08:30.375311Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (58.70% complete) sector_index=27
2024-02-22T23:11:05.411650Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (58.70% complete) sector_index=27
2024-02-22T23:13:52.612714Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (60.87% complete) sector_index=28
2024-02-22T23:16:22.782877Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (60.87% complete) sector_index=28
2024-02-22T23:19:13.873274Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (63.04% complete) sector_index=29
2024-02-22T23:21:55.543164Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (63.04% complete) sector_index=29
2024-02-22T23:24:46.077970Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (65.22% complete) sector_index=30
2024-02-22T23:27:30.367170Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (65.22% complete) sector_index=30
2024-02-22T23:30:21.355338Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (67.39% complete) sector_index=31
2024-02-22T23:33:01.408828Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (67.39% complete) sector_index=31
2024-02-22T23:35:49.261606Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (69.57% complete) sector_index=32
2024-02-22T23:38:25.919072Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (69.57% complete) sector_index=32
2024-02-22T23:41:08.863843Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (71.74% complete) sector_index=33
2024-02-22T23:43:43.855034Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (71.74% complete) sector_index=33
2024-02-22T23:46:28.222930Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (73.91% complete) sector_index=34
2024-02-22T23:49:00.420221Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (73.91% complete) sector_index=34
2024-02-22T23:51:47.184596Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (76.09% complete) sector_index=35
2024-02-22T23:54:19.358789Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (76.09% complete) sector_index=35
2024-02-22T23:57:02.650841Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (78.26% complete) sector_index=36
2024-02-22T23:59:34.344163Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (78.26% complete) sector_index=36
2024-02-23T00:02:21.053666Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (80.43% complete) sector_index=37
2024-02-23T00:04:51.751219Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (80.43% complete) sector_index=37
2024-02-23T00:07:40.218205Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (82.61% complete) sector_index=38
2024-02-23T00:10:11.232756Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (82.61% complete) sector_index=38
2024-02-23T00:12:56.379859Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (84.78% complete) sector_index=39
2024-02-23T00:15:28.623897Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (84.78% complete) sector_index=39
2024-02-23T00:18:15.824437Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (86.96% complete) sector_index=40
2024-02-23T00:20:46.151481Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (86.96% complete) sector_index=40
2024-02-23T00:23:33.979175Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (89.13% complete) sector_index=41
2024-02-23T00:26:05.907303Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (89.13% complete) sector_index=41
2024-02-23T00:28:52.761026Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (91.30% complete) sector_index=42
2024-02-23T00:31:24.106270Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (91.30% complete) sector_index=42
2024-02-23T00:34:10.025899Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (93.48% complete) sector_index=43
2024-02-23T00:36:40.536152Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (93.48% complete) sector_index=43
2024-02-23T00:39:27.242852Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (95.65% complete) sector_index=44
2024-02-23T00:41:59.975354Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (95.65% complete) sector_index=44
2024-02-23T00:44:50.701104Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Plotting sector (97.83% complete) sector_index=45
2024-02-23T00:47:20.228615Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Plotting sector (97.83% complete) sector_index=45
2024-02-23T00:49:54.821175Z  INFO {disk_farm_index=0}: subspace_farmer::single_disk_farm::plotting: Initial plotting complete
2024-02-23T00:51:30.373423Z  INFO {disk_farm_index=1}: subspace_farmer::single_disk_farm::plotting: Initial plotting complete

Disk Farm Index 0:
    Sector 0: 20:37:50
    Sector 1: 20:44:26
    Sector 2: 20:49:47
    Sector 3: 20:54:56
    Sector 4: 21:00:29
    ...
    Sector 45: 00:44:50
    Initial plotting complete: 00:49:54

Disk Farm Index 1:
    Sector 0: 20:37:50
    Sector 1: 20:44:38
    Sector 2: 20:50:49
    Sector 3: 20:56:34
    Sector 4: 21:02:05
    ...
    Sector 45: 00:47:20
    Initial plotting complete: 00:51:30

if we compare the timestamps for the “Initial plotting complete” event, we see that disk farm index 0 (mounted with -m 0) completed the entire plotting process at 00:49:54, while disk farm index 1 (mounted with -m 0 -t largefile4) completed it at 00:51:30.

Conclusion

Between two 50 Gb plots located on the same hardware, with all else being equal, the one mounted with the -m 0 option completed the entire plotting process 1 minute and 35.552248 seconds faster than the one mounted with -m 0 -t largefile4