Station Data format
The station data contains the following information.
Variable information for hourly data
COMMA SEPARATED VALUE (“csv”) Format description
SiteNum |
Year |
Day_of_Year |
HrMin |
Lat |
Lon |
VersionNum |
|
TAIR1(1) |
TAIR1(2) |
… |
TAIR1(12) |
TAIR2(1) |
TAIR2(2) |
… |
TAIR2(12) |
TAIR3(1) |
TAIR3(2) |
… |
TAIR3(12) |
VWPCP1(1) |
VWPCP1(2) |
… |
VWPCP1(12) |
VWPCP2(1) |
VWPCP2(2) |
… |
VWPCP2(12) |
VWPCP3(1) |
VWPCP3(2) |
… |
VWPCP3(12) |
WET1(1) |
WET1(2) |
… |
WET1(12) |
WET2(1) |
WET2(2) |
… |
WET2(12) |
TAIR1_5mn_Min |
TAIR2_5mn_Min |
TAIR3_5mn_Min |
TAIR1_5mn_Max |
TAIR2_5mn_Max |
TAIR3_5mn_Max |
T1Cal_Std |
T2Cal_Std |
T3Cal_Std |
FANSP1_Avg |
FANSP2_Avg |
BATVolt_Avg |
PSVoltFL |
DoorTime_Tot |
TPRECP_Max |
RefRes_Avg |
DSignTR |
TotHTR |
TotDoor |
XMTPWF |
XMTPWR |
unknown |
Data description
HrMin is the time (for example, 100 is 1:00)
TAIR1(12) is the data 5 minutes after HrMin
TAIR1(11) is the data 10 minutes after HrMin
TAIR1(1) is the data 55 minutes after HrMin:
The CSV data example
1126,2009,195,100,37.51722,-111.9775,6.101,31.47,31.53,31.79,31.61,31.69,32.07,32.14,32.17,32.28,32.27,32.38,32.46,31.47,31.54,31.78,31.62,31.69,32.08,32.15,32.2,32.27,32.29,32.37,32.48,31.46,31.52,31.78,31.6,31.67,32.07,32.14,32.18,32.27,32.27,32.39,32.45,93.13358,93.13358,93.12943,93.12525,93.12943,93.13358,93.13358,93.13776,93.14191,93.13776,93.14191,93.14609,94.32089,94.32507,94.32507,94.32089,94.31257,94.3084,94.31673,94.30424,94.29175,94.28757,94.28757,94.32089,92.22306,92.22717,92.22717,92.22306,92.22717,92.22306,92.21896,92.21896,92.21896,92.22306,92.21484,92.21484,1166,1170,1173,1175,1178,1181,1183,1185,1186,1188,1191,1192,2988,2988,2988,2988,2988,2988,2988,2988,2988,2988,2988,2988,31.4423,31.44466,31.43211,32.54517,32.54897,32.54406,0.405,0.401,0.409,116.1,0,12.73,125,1.5,38.96,1499.849,19142,0,512,400,310,-6666
1126,2009,195,200,37.51722,-111.9775,6.101,30.07,30.19,30.26,30.39,30.58,30.78,30.88,30.95,31.09,31.06,31.13,31.36,30.06,30.17,30.24,30.37,30.57,30.76,30.86,30.94,31.08,31.05,31.12,31.36,30.06,30.17,30.25,30.38,30.56,30.77,30.86,30.93,31.08,31.05,31.12,31.34,93.14609,93.14191,93.13776,93.13358,93.12943,93.13358,93.13776,93.12943,93.12943,93.13358,93.12943,93.12943,94.34171,94.33338,94.33338,94.32922,94.32922,94.32922,94.32507,94.32507,94.3084,94.35006,94.32089,94.32507,92.23129,92.23129,92.22717,92.23539,92.23539,92.23539,92.23129,92.23539,92.23129,92.22306,92.21896,92.22306,1149,1150,1151,1151,1152,1153,1154,1155,1136,1159,1160,1164,2988,2988,2988,2988,2988,2988,2988,2988,2988,2988,2988,2987,3
....
Merge mutiple data
If you have multiple original files, you can merge these files into one file.
$ ls
cd0e913e_20120727.csv-001 cd10c2b4_20120728.csv-001 cd10c2b4_20120728.csv-022 cd1160b6_20120728.csv-020
cd0e913e_20120727.csv-002 cd10c2b4_20120728.csv-002 cd10c2b4_20120728.csv-023 cd1160b6_20120728.csv-021
cd0e913e_20120727.csv-003 cd10c2b4_20120728.csv-003 cd1160b6_20120728.csv-001 cd1160b6_20120728.csv-022
cd0e913e_20120727.csv-004 cd10c2b4_20120728.csv-004 cd1160b6_20120728.csv-002 cd1160b6_20120728.csv-023
cd0e913e_20120727.csv-005 cd10c2b4_20120728.csv-005 cd1160b6_20120728.csv-003 cd13c5ba_20120727.csv-001
cd0e913e_20120727.csv-006 cd10c2b4_20120728.csv-006 cd1160b6_20120728.csv-004 cd13c5ba_20120727.csv-002
cd0e913e_20120727.csv-007 cd10c2b4_20120728.csv-007 cd1160b6_20120728.csv-005 cd13c5ba_20120727.csv-003
cd0e913e_20120727.csv-008 cd10c2b4_20120728.csv-008 cd1160b6_20120728.csv-006 cd13c5ba_20120727.csv-004
cd0e913e_20120727.csv-009 cd10c2b4_20120728.csv-009 cd1160b6_20120728.csv-007 cd13c5ba_20120727.csv-005
$ awk 1 cd0e913e_20120727.csv-0* > cd0e913e_20120727.csv
Sometimes the cat command connects the data in two files in succession. The awk is better for this merge.