Problems with compute_cc

[JuanRuedaNunez]

After installing MSNOISE in a UBUNTU virtual machine, I have loaded my SeisComP structured data (SDS) in db and I created the cross-correlation jobs correctly from data_availability..
But, when I run "compute_cc" it doesn't compute the correlations and I get the following output for all pairs:

(msnoise) sysop at ogcvm01:~$ msnoise -v compute_cc
2023-02-28 15:41:42.598632 msnoise [pid 188872][INFO]: *** Starting: Compute CC ***
2023-02-28 15:41:42.641014 msnoise [pid 188872][INFO]: Will compute [ZZ] for different stations
2023-02-28 15:41:42.641259 msnoise [pid 188872][INFO]: Will compute [] for single stations
2023-02-28 15:41:42.641464 msnoise [pid 188872][INFO]: Checking if there are jobs to do
2023-02-28 15:41:42.644425 msnoise [pid 188872][INFO]: Getting the next job
2023-02-28 15:41:42.658902 msnoise [pid 188872][INFO]: New CC Job: 2017-02-08 (3 pairs with 3 stations)
2023-02-28 15:41:42.797933 msnoise [pid 188872][DEBUG]: ES.EGOM.Z Reading 1 Files
2023-02-28 15:41:42.798029 msnoise [pid 188872][DEBUG]: ERROR reading file /nfs/respaldo1/CANARIAS/2017/ES/EGOM/HHZ.D/ES.EGOM..HHZ.D.2017.039
2023-02-28 15:41:42.798128 msnoise [pid 188872][DEBUG]: ES.EHIG.Z Reading 1 Files
2023-02-28 15:41:42.798176 msnoise [pid 188872][DEBUG]: ERROR reading file /nfs/respaldo1/CANARIAS/2017/ES/EHIG/HHZ.D/ES.EHIG..HHZ.D.2017.039
2023-02-28 15:41:42.798240 msnoise [pid 188872][DEBUG]: ES.TBT.Z Reading 2 Files
2023-02-28 15:41:42.798282 msnoise [pid 188872][DEBUG]: ERROR reading file /nfs/respaldo1/CANARIAS/2017/ES/TBT/HHZ.D/ES.TBT..HHZ.D.2017.039
2023-02-28 15:41:42.798317 msnoise [pid 188872][DEBUG]: ERROR reading file /nfs/respaldo1/CANARIAS/2017/ES/TBT/SHZ.D/ES.TBT..SHZ.D.2017.039
2023-02-28 15:41:42.798403 msnoise [pid 188872][DEBUG]: Not enough data for this day !
2023-02-28 15:41:42.798433 msnoise [pid 188872][DEBUG]: Marking job Done and continuing with next !
2023-02-28 15:41:42.817136 msnoise [pid 188872][INFO]: Getting the next job

The path to my data is correct, but I seem to have a problem. You can help?

Thaks
Juan

[ThomasLecocq]

The /nfs/respaldo1/CANARIAS/2017/ES/EGOM/HHZ.D/ES.EGOM..HHZ.D.2017.039 loads correctly in obspy when you open it directly?

[JaimeBarcoTorre]

Dear Thomas,

we discovered the problem.

In /opt/conda/envs/msnoise/lib/python3.11/site-packages/msnoise/preprocessing.py, line 144, the miniseed file is opened with the option "dtype=np.float".

Since the numpy installed version is 1.24.2 the above datatype is no longer valid (https://stackoverflow.com/questions/74844262/how-can-i-solve-error-module-numpy-has-no-attribute-float-in-python) and must be replaced with the python's builtin float.

Changing all the ocurrences in all the affected files did the trick.

Another issue we found is in "api.py" regarding the import of scipy versions:

if sp.__version__ < "1.4.0"

The installed version of scipy is 1.10.0 and the version check by string comparation is not valid
https://stackoverflow.com/questions/11887762/how-do-i-compare-version-numbers-in-python/74401636#74401636

Using:

from packaging import version
if version.parse(sp.__version__) < version.parse('1.4.0'):

and changing all the references of sf to sff in the affected files solved the problem.

Best regards,

Jaime

[JuanRuedaNunez]

Thanks Jaime, thanks thomas.
Compute_cc works correctly

[ThomasLecocq]

Hey, thanks for finding the solution. Indeed, 1.6.x branch is getting old and I should release msnoise2 that is ready somehow in the master branch ...