SPEC SFS 2014 EDA Workload简单说明

默认Benchmark

    
        100
        3
        16k
        10
        10
    
    
        75
        2
        10m
        10
        5
    
    300
    75
    95
    5

负载启动后会启动5个进程，2个后端，3个前端

Test run time = 300 seconds, Warmup = 300 seconds.
Running 5 copies of the test on 1 clients
Results directory: /opt/specsfs2014/results
Op latency reporting activated
Clients have a total of 1024 MiBytes of memory
Clients have 204 MiBytes of memory size per process
Clients each have 5 processes
Adjustable aggregate data set value set to 1024 MiBytes
Starting tests: Thu Jun  7 10:40:21 2018

   Launching 5 processes.
   Starting test client:   0 Host:  localhost    Workload:    EDA_BACKEND  Location: 
   Starting test client:   1 Host:  localhost    Workload:    EDA_BACKEND  Location: 
   Starting test client:   2 Host:  localhost    Workload:   EDA_FRONTEND  Location: 
   Starting test client:   3 Host:  localhost    Workload:   EDA_FRONTEND  Location: 
   Starting test client:   4 Host:  localhost    Workload:   EDA_FRONTEND  Location: 

生成目录如下

drwxr-xr-x.  7 root root  7 Jun  7 10:23 CL0_EDA_BACKEND
drwxr-xr-x.  7 root root  7 Jun  7 10:23 CL1_EDA_BACKEND
drwxr-xr-x. 12 root root 12 Jun  7 10:23 CL2_EDA_FRONTEND
drwxr-xr-x. 12 root root 12 Jun  7 10:23 CL3_EDA_FRONTEND
drwxr-xr-x. 12 root root 12 Jun  7 10:23 CL4_EDA_FRONTEND

根据Benchmark文件配，每个前端进程创建10个子目录，10

每个后端进程创建5个子目录，5

[root@localhost CL2_EDA_FRONTEND]# ll
total 40
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir0
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir1
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir2
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir3
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir4
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir5
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir6
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir7
drwxr-xr-x. 28 root root 28 Jun  7 10:51 Dir8
drwxr-xr-x. 28 root root 28 Jun  7 10:50 Dir9

特别说明一下

所有前端目录和后端目录Dir*都会创建名字为buket*的子目录
前端的bucket子目录是26个，后端的bucket子目录是24个

[root@localhost Dir0]# ll
total 104
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket0
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket1
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket10
drwxr-xr-x. 2 root root  2 Jun  7 10:51 bucket11
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket12
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket13
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket14
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket15
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket16
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket17
drwxr-xr-x. 2 root root 12 Jun  7 10:24 bucket18
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket19
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket2
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket20
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket21
drwxr-xr-x. 2 root root 12 Jun  7 10:50 bucket22
drwxr-xr-x. 2 root root  2 Jun  7 10:40 bucket23
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket24
drwxr-xr-x. 2 root root 12 Jun  7 10:40 bucket25
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket3
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket4
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket5
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket6
drwxr-xr-x. 2 root root  2 Jun  7 10:51 bucket7
drwxr-xr-x. 2 root root 12 Jun  7 10:50 bucket8
drwxr-xr-x. 2 root root 12 Jun  7 10:23 bucket9

[root@localhost Dir0]# pwd
CL0_EDA_BACKEND/Dir0
[root@localhost Dir0]# ls | wc -l
24
[root@localhost Dir0]#pwd
CL2_EDA_FRONTEND/Dir0
[root@localhost Dir0]# ls | wc -l
26

Benchmark配置文件中的每个目录文件数10是指的bucket*子目录的文件数

创建的目录总数

[root@localhost spec]# ls -lR | grep "^d" | wc -l
1065

1065=5+2*(5*24+5)+3*(10*26+10)

创建的文件总数

[root@localhost spec]# ls -lR | grep "^-" | wc -l
9200

9200=2*5*23*10+3*10*23*10

这里的23是每个目录下的子目录数，不是24或26，而是23

创建的总文件大小

[root@localhost spec]# du -ah
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket7
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/sdacihi2.ec
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/mmdfbh4.drn
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/atees6.nrfao
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/sehi8.l
4.0K    ./CL2_EDA_FRONTEND/Dir7/bucket24/toc5.ruvh
...
36K     ./CL4_EDA_FRONTEND/Dir4/bucket5/smiu6.sr
28K     ./CL4_EDA_FRONTEND/Dir4/bucket5/lee5.lu
28K     ./CL4_EDA_FRONTEND/Dir4/bucket5/sittole0.uez
36K     ./CL4_EDA_FRONTEND/Dir4/bucket5/rwinhhc9.tliil
20K     ./CL4_EDA_FRONTEND/Dir4/bucket5/enhiochg7.aoo
300K    ./CL4_EDA_FRONTEND/Dir4/bucket5
3.1M    ./CL4_EDA_FRONTEND/Dir4
31M     ./CL4_EDA_FRONTEND
11G     .
[root@localhost spec]#

测试产生的文件操作有

    Write              
    Write_file         
    Mmap_write         
    Mmap_read          
    Read               
    Read_file          
    Mkdir              
    Rmdir              
    Unlink             
    Unlink2            
    Create             
    Stat               
    Append             
    Lock               
    Access             
    Chmod              
    Readdir            
    Random_write       
    Random_read        
    Read_modify_write  
    Open file          
    Close file         
    Copyfile           
    Rename             
    Statfs             
    Pathconf           
    Custom1            
    Custom2