Switching conda to Tsinghua mirror and error handling

🛠 Tools and Programming 💻Programming
1

Original article link https://zhuanlan.zhihu.com/p/585792349

I searched a lot online, but nothing worked. I found the official instructions from Tsinghua Mirror Site, which work well. These are included in various tutorials for changing sources of major software; no need to search blindly anymore.

anaconda | Mirror Site Usage Help | Tsinghua University Open Source Software Mirror | Tsinghua Open Source Mirror

Original quote as follows:

Anaconda Mirror Usage Help

Anaconda is a Python distribution used for scientific computing, supporting Linux, Mac, Windows, and includes many popular Python packages for scientific computing and data analysis.

Anaconda installation packages can be downloaded from https://mirrors.tuna.tsinghua.edu.cn/anaconda/archive/.

TUNA also provides mirrors for Anaconda repositories and third-party sources (conda-forge, msys2, pytorch, etc., view full list; more third-party sources can be found at Campus Network Joint Mirror Site). All systems can use the TUNA mirror source by modifying the .condarc file under the user directory. Windows users cannot directly create a file named .condarc; they can first execute conda config --set show_channel_urls yes to generate the file, then modify it.

Note: Due to rapid updates that are difficult to synchronize, we do not synchronize the three packages pytorch-nightly, pytorch-nightly-cpu, and ignite-nightly.

channels:
  - defaults
show_channel_urls: true
default_channels:
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/r
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/msys2
custom_channels:
  conda-forge: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  msys2: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  bioconda: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  menpo: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch-lts: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  simpleitk: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud

This adds the free Anaconda Python repositories.

Run conda clean -i to clear the index cache to ensure the index provided by the mirror site is used.

Run conda create -n myenv numpy to test it.

Miniconda Mirror Usage Help

Miniconda is a lightweight alternative to Anaconda, which by default only contains Python and conda but allows you to install required packages via pip and conda.

Miniconda installation packages can be downloaded from https://mirrors.tuna.tsinghua.edu.cn/anaconda/miniconda/.

Other Third-Party Sources

For other third-party sources of conda, if needed, modify the anaconda.py file and submit a pull request. We will consider various factors and adjust accordingly.

https://zhuanlan.zhihu.com/p/597829245?

Solution to Errors After Changing Anaconda to Tsinghua Source (1)

Original article link https://zhuanlan.zhihu.com/p/597829245

In a previous source switching tutorial, it mentioned

All systems can use the TUNA mirror source by modifying the .condarc file under the user directory. Windows users cannot directly create a file named .condarc; they can first execute conda config --set show_channel_urls yes to generate the file, then modify it.

After generating .condarc by executing conda config --set show_channel_urls yes, when modifying, you must replace all content inside with

channels:
  - defaults
show_channel_urls: true
default_channels:
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/r
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/msys2
custom_channels:
  conda-forge: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  msys2: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  bioconda: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  menpo: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch-lts: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  simpleitk: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud

Do not directly paste it after, otherwise your .condarc would be

show_channel_urls: true
channels:
  - defaults
show_channel_urls: true
default_channels:
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/r
  - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/msys2
custom_channels:
  conda-forge: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  msys2: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  bioconda: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  menpo: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  pytorch-lts: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
  simpleitk: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud

An extra line

show_channel_urls: true

will cause subsequent conda clean -i to fail with error

>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<

    Traceback (most recent call last):
      File "conda/exceptions.py", line 1118, in __call__
      File "conda/cli/main.py", line 61, in main_subshell
      File "conda/base/context.py", line 399, in __init__
      File "conda/common/configuration.py", line 1291, in __init__
      File "conda/common/configuration.py", line 1297, in _set_search_path
      File "conda/common/configuration.py", line 488, in load_file_configs
      File "conda/common/configuration.py", line 488, in <genexpr>
      File "conda/common/configuration.py", line 461, in _file_loader
      File "conda/common/configuration.py", line 387, in m
```ake_raw_parameters_from_file
      File "conda/common/serialize.py", line 57, in yaml_round_trip_load
      File "ruamel/yaml/main.py", line 434, in load
      File "ruamel/yaml/constructor.py", line 121, in get_single_data
      File "ruamel/yaml/constructor.py", line 131, in construct_document
      File "ruamel/yaml/constructor.py", line 1569, in construct_yaml_map
      File "ruamel/yaml/constructor.py", line 1453, in construct_mapping
      File "ruamel/yaml/constructor.py", line 294, in check_mapping_key
    ruamel.yaml.constructor.DuplicateKeyError: while constructing a mapping
      in "/root/.condarc", line 1, column 1
    found duplicate key "show_channel_urls" with value "True" (original value: "True")
      in "/root/.condarc", line 4, column 1
    
    To suppress this check see:
        http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys
    

`$ /root/miniconda3/conda.exe install --offline --file /root/miniconda3/pkgs/env.txt -yp /root/miniconda3`

  environment variables:
                 CIO_TEST=<not set>
           CONDA_CHANNELS=https://repo.anaconda.com/pkgs/main,https://repo.anaconda.com/pkgs/r
                CONDA_EXE=/root/miniconda3/bin/conda
CONDA_EXTRA_SAFETY_CHECKS=no
          CONDA_PKGS_DIRS=/root/miniconda3/pkgs
         CONDA_PYTHON_EXE=/root/miniconda3/bin/python
               CONDA_ROOT=/root/miniconda3/install_tmp/_MEIbiVABH
      CONDA_SAFETY_CHECKS=disabled
              CONDA_SHLVL=0
           CURL_CA_BUNDLE=<not set>
          LD_LIBRARY_PATH=/root/miniconda3/install_tmp/_MEIbiVABH
               LD_PRELOAD=<not set>
      OLD_LD_LIBRARY_PATH=
                     PATH=/root/miniconda3/condabin:/usr/anaconda3/bin:/usr/local/sbin:/usr/loca
                          l/bin:/usr/sbin:/usr/bin:/root/bin
       REQUESTS_CA_BUNDLE=<not set>
            SSL_CERT_FILE=<not set>

     active environment : None
            shell level : 0
       user config file : /root/.condarc
 populated config files : 
          conda version : 22.11.1
    conda-build version : not installed
         python version : 3.9.15.final.0
       virtual packages : __archspec=1=x86_64
                          __glibc=2.17=0
                          __linux=3.10.0=0
                          __unix=0=0
       base environment : /root/miniconda3/install_tmp/_MEIbiVABH  (read only)
      conda av data dir : /root/miniconda3/install_tmp/_MEIbiVABH/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /root/miniconda3/install_tmp/_MEIbiVABH/pkgs
                          /root/.conda/pkgs
       envs directories : /root/.conda/envs
                          /root/miniconda3/install_tmp/_MEIbiVABH/envs
               platform : linux-64
             user-agent : conda/22.11.1 requests/2.28.1 CPython/3.9.15 Linux/3.10.0-1160.45.1.el7.x86_64 centos/7.6.1810 glibc/2.17
                UID:GID : 0:0
             netrc file : None
           offline mode : False


An unexpected error has occurred. Conda has prepared the above report.

If submitted, this report will be used by core maintainers to improve
future releases of conda.
Would you like conda to send this report to the core maintainers? [y/N]:  
Timeout reached. No report sent.

Seeing this long error message, I was stunned. After calming down, I finally realized it was caused by having two lines with show_channel_urls: true in the .condarc file.

Haha, I even spent quite some time checking what An unexpected error has occurred. Conda has prepared the above report. meant. It turns out the cause of the error is written right at the very beginning of the message, how embarrassing.