README.md

    PythonCode

    pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple

    pip install -r requirements.txt

    pip install -r

    A B C
    Vscode https://xiaolin.lanzouo.com/irHDS131j4mb py38
    miniconda_all国外 https://docs.conda.io/en/latest/miniconda.html python3.7

    PythonCode

    if not exist "d:\PythonCode": mkdir "d:\PythonCode"
    cd /d "d:\PythonCode"
    start "" "D:\PythonCode" 
    
    • conda config --set show_channel_urls yes
    • pip config set global.cache-dir "E:\pipcache"
    • pip --trusted-host pypi.python.org --trusted-host pypi.tuna.tsinghua.edu.cn install pyqt5 -i https://pypi.tuna.tsinghua.edu.cn/simple/

    conda create -p d:\PythonCode\py38 python=3.8 -y 

    pip install pandas==1.3 matplotlib==3.3 openpyxl xlrd seaborn

    yolo5

    🆓电子书资源🆓

    💰可视化系统展示💰

    🆓可视化系统展示🆓

    flask+mysql

    Django

    PyQt

    新系统必备

    效率工具

    非公开!🔐

    数据预测

    数据预测sklearn、tf

    pdf处理pymypdf

    图像处理

    可视化系统

    python学习总文件夹🔐

    NLP语料库🔐

    pyside2软件

    变量预测

    打包环境设置

    • 虚拟环境生成venv
    • pip install pyside2 requests setuptools==19.0 pyinstaller -i http://pypi.douban.com/simple/ --trusted-host pypi.douban.com
    • pyinstaller -F -w main.py --noconsole
      • 可以加上--hidden-import numpy 避免出现运行时找不到model的情况
    • 尽量使用from import 可以避免打包文件过大
    • 代码混淆

    小程序代码以及软著材料

    环境安装常用
    • set-executionpolicy remotesigned

    • 北外

    清华源

    • conda clean -i
    • conda config --append channels conda-forge
    
    channels:
      - defaults
    show_channel_urls: true
    default_channels:
      - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
      - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/r
      - https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/msys2
    custom_channels:
      conda-forge: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
      msys2: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
      bioconda: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
      menpo: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
      pytorch: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
      pytorch-lts: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
      simpleitk: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
    
    • 修改cache
    envs_dirs:
      - E:\condaenvs
    pkgs_dirs:
      - E:\condacache
    pip config set global.cache-dir "E:\pipcache"

    软件清单

    软件 链接
    Vscode https://xiaolin.lanzouo.com/b0chdra0f 密码:code
    miniconda_all国外 https://docs.conda.io/en/latest/miniconda.html
    miniconda_310国外 https://repo.anaconda.com/miniconda/Miniconda3-py310_23.5.2-0-Windows-x86_64.exe
    清华镜像miniconda下载 清华镜像miniconda下载
    2022.2.5-PyCharm-community 2022.2.5-PyCharm-community
    python3.7及其他切换分支 python3.7
    python36-8_embed python_embed
    python35 python35
    miniforge-mac-tensorflow tensorflow
    PyCharm_otherVersion https://www.jetbrains.com/pycharm/download/other.html
    MySql5.7installer 5.7installer
    MySql8.x 数据库8.x
    cudnn (tf-gpu所需也可不下) https://developer.nvidia.com/rdp/cudnn-download
    cuda-toolkit(tf-gpu所需也可不下) https://developer.nvidia.com/cuda-toolkit-archive
    Vmware17 https://gitcode.net/k54kdk/GIS_soft/-/tree/vmware17
    GDAL https://gitcode.net/k54kdk/gdal_wheel
    最低适配torch1.4 torch-geometric
    下载chromedriver 下载chromedriver
    最新版chromedriver 最新版chromedriver
    FireFox FireFox
    microsoft-edge microsoft-edge
    SPARK SPARK
    java java
    jdk-8u191-windows jdk-8u191-windows
    Hadoop Hadoop
    spark3.2.1 spark3
    Hadoop2.7.7 Hadoop
    redis redis
    postgresql postgresql-12
    huggingface模型镜像 huggingface
    雷电 雷电密码52pj
    apis HibiAPI
    apis bilibili
    示例使用 https://api.obfs.dev/api/netease/album?id=162801126
    • conda create -p d:\PythonCode\py38 python=3.8 ipykernel -y 
    • conda create -p d:\PythonCode\py37 python=3.7 ipykernel -y 
    • conda create -p d:\PythonCode\py36 python=3.6 ipykernel -y 
    • conda create -p d:\PythonCode\py36 python=3.6 ipykernel tensorflow==1.10.0 -y
    • conda create -p d:\PythonCode\py35 python=3.5 ipykernel -y 
    • conda create -p d:\PythonCode\py27 python=2.7 ipykernel -y 
    • conda create -p d:\PythonCode\py38 python=3.8 -y 
    • conda create -p d:\PythonCode\py37 python=3.7 -y 
    • conda create -p d:\PythonCode\py36 python=3.6 -y 
    • conda create -p d:\PythonCode\py36 python=3.6 tensorflow==1.10.0 -y
    • conda create -p d:\PythonCode\py35 python=3.5 -y 
    • conda create -p d:\PythonCode\py27 python=2.7 -y 
    • c:\ProgramData\miniconda3\Scripts\conda.exe create -p d:\L\kd\ven_py38 python=3.8 ipykernel -y
    • conda env remove -p c:\PythonCode\py36
    • conda create -p D:\open3d\py38torch113 --clone D:\open3d\py38torch17
    • conda env create -f environment.yaml
    • conda env update -n my_env --file ENV.yaml
    • conda env export > py36.yaml

    pip

    pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple
    
    pip freeze 
    
    pip list --format=freeze > requirements.txt
    需要删除的包  wheel  pip   setuptools
    -i http://pypi.douban.com/simple/ --trusted-host pypi.douban.com
    
    -i https://pypi.douban.com/simple 
    
    -i https://mirrors.aliyun.com/pypi/simple/

    数据库

    • 移除命令
      • mysqld.exe remove

    数据库8.x

    • navicat默认没连上,1251
    • 需要更改加密方式,进入mysql 8 command line client
    • ALTER USER 'root'@'localhost' IDENTIFIED BY '123456' PASSWORD EXPIRE NEVER;
    • ALTER USER 'root'@'localhost' IDENTIFIED WITH mysql_native_password BY '123456';
    • FLUSH PRIVILEGES;

    三方包

    tf1.x

    pip install tensorflow==1.10.0 -i https://pypi.tuna.tsinghua.edu.cn/simple

    GPU

    tf2.4gpu+cuda11.6

    pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple
    
    tensorflow-gpu==2.4.0 
    scipy==1.4.1
    numpy==1.19.2
    matplotlib==3.2.1
    opencv_python==4.2.0.34
    tqdm==4.46.1
    Pillow==8.2.0
    h5py==2.10.0
    scikit-learn
    Cython

    https://developer.nvidia.com/rdp/cudnn-download

    https://developer.nvidia.com/cuda-toolkit-archive

    • conda install cudatoolkit==11.0.3
    • conda install cudnn==8.0.5.39
    • conda search cudnn -c conda-forge
    • (找不到就搜索一下存在的版本号
    # Name                  Version           Build  Channel
    cudnn                       6.0               0  anaconda/pkgs/free
    cudnn                       6.0               0  pkgs/free
    cudnn                     7.1.4       cuda8.0_0  anaconda/pkgs/main
    cudnn                     7.1.4       cuda8.0_0  pkgs/main
    cudnn                     7.1.4       cuda9.0_0  anaconda/pkgs/main
    cudnn                     7.1.4       cuda9.0_0  pkgs/main
    cudnn                     7.3.1      cuda10.0_0  anaconda/pkgs/main
    cudnn                     7.3.1      cuda10.0_0  pkgs/main
    cudnn                     7.3.1       cuda9.0_0  anaconda/pkgs/main
    cudnn                     7.3.1       cuda9.0_0  pkgs/main
    cudnn                     7.6.0      cuda10.0_0  anaconda/pkgs/main
    cudnn                     7.6.0      cuda10.0_0  pkgs/main
    cudnn                     7.6.0      cuda10.1_0  anaconda/pkgs/main
    cudnn                     7.6.0      cuda10.1_0  pkgs/main
    cudnn                     7.6.0       cuda9.0_0  anaconda/pkgs/main
    cudnn                     7.6.0       cuda9.0_0  pkgs/main
    cudnn                     7.6.4      cuda10.0_0  anaconda/pkgs/main
    cudnn                     7.6.4      cuda10.0_0  pkgs/main
    cudnn                     7.6.4      cuda10.1_0  anaconda/pkgs/main
    cudnn                     7.6.4      cuda10.1_0  pkgs/main
    cudnn                     7.6.4       cuda9.0_0  anaconda/pkgs/main
    cudnn                     7.6.4       cuda9.0_0  pkgs/main
    cudnn                     7.6.5      cuda10.0_0  anaconda/pkgs/main
    cudnn                     7.6.5      cuda10.0_0  pkgs/main
    cudnn                     7.6.5      cuda10.1_0  anaconda/pkgs/main
    cudnn                     7.6.5      cuda10.1_0  pkgs/main
    cudnn                     7.6.5      cuda10.2_0  anaconda/pkgs/main
    cudnn                     7.6.5      cuda10.2_0  pkgs/main
    cudnn                     7.6.5       cuda9.0_0  anaconda/pkgs/main
    cudnn                     7.6.5       cuda9.0_0  pkgs/main
    cudnn                     7.6.5       cuda9.2_0  anaconda/pkgs/main
    cudnn                     7.6.5       cuda9.2_0  pkgs/main
    cudnn                     8.2.1      cuda11.3_0  anaconda/pkgs/main
    cudnn                     8.2.1      cuda11.3_0  pkgs/main
    cudnn                  8.9.2.26        cuda11_0  anaconda/pkgs/main
    cudnn                  8.9.2.26        cuda11_0  pkgs/main
    import tensorflow as tf
    tf.config.list_physical_devices('GPU')
    import torch
    print(torch.cuda.is_available())

    tensorflow_gpu版本匹配

    torch

    pip install torch==1.3.1+cpu torchvision==0.4.2+cpu -f https://download.pytorch.org/whl/torch_stable.html
    
    pip install torch==1.12.0+cu116 torchvision==0.13.0+cu116 torchaudio==0.12.0+cu116 -f https://download.pytorch.org/whl/torch_stable.html
    pip install torch==1.10.0+cu113 torchvision==0.11.1+cu113 torchaudio==0.10.0+cu113 -f https://download.pytorch.org/whl/torch_stable.html

    第三方包scatter等

    https://pytorch-geometric.com/whl/

    jdk

    node

    taobao reason: certificate has expired

    settings

    tf-gpu

    https://tensorflow.google.cn/install/source_windows?hl=zh-cn#gpu

    torch-gpu-pip

    torch torchvision torchtext python
    2.0.0 0.15.1 >=3.8, <=3.10
    1.13.0 0.14.0 0.14.0 >=3.7.2, <=3.10
    1.12.0 0.13.0 0.13.0 >=3.7, <=3.10
    1.11.0 0.12.3 0.12.0 >=3.7, <=3.10
    1.10.2 0.11.3 0.11.0 >=3.6, <=3.9
    1.10.1 0.11.2 0.11.0 >=3.6, <=3.9
    1.10.0 0.11.1 0.11.0 >=3.6, <=3.9
    1.9.1 0.10.1 0.10.1 >=3.6, <=3.9
    1.9.0 0.10.0 0.10 >=3.6, <=3.9
    1.8.2 0.9.2 0.9 >=3.6, <=3.9
    1.8.1 0.9.1 0.9 >=3.6, <=3.9
    1.8.0 0.9.0 0.9 >=3.6, <=3.9
    1.7.1 0.8.2 0.8.1 >=3.6, <=3.9
    1.7.0 0.8.1 0.8 >=3.6, <=3.8
    1.7.0 0.8.0 0.8 >=3.6, <=3.8
    1.6.0 0.7.0 0.7 >=3.6, <=3.8
    1.5.1 0.6.1 0.6 >=3.5, <=3.8
    1.5.0 0.6.0 0.6 >=3.5, <=3.8
    1.4.0 0.5.0 0.5 ==2.7, >=3.5, <=3.8
    1.3.1 0.4.2 ==2.7, >=3.5, <=3.7
    1.3.0 0.4.1 ==2.7, >=3.5, <=3.7
    1.2.0 0.4.0 ==2.7, >=3.5, <=3.7
    1.1.0 0.3.0 ==2.7, >=3.5, <=3.7
    <=1.0.1 0.2.2 ==2.7, >=3.5, <=3.7
    
    >       torch	       torchaudio	          python
    
       > main / nightly	main / nightly	>=3.8, <=3.10
       > 2.0.0	          2.0.1	        >=3.8, <=3.10
       > 1.13.1	          0.13.1	    >=3.7, <=3.10
       > 1.13.0	          0.13.0	    >=3.7, <=3.10
       > 1.12.0	          0.12.0	    >=3.7, <=3.10
       > 1.11.0	          0.11.0	    >=3.7, <=3.9
       > 1.10.0	          0.10.0	    >=3.6, <=3.9
       > 1.9.1	          0.9.1	        >=3.6, <=3.9
       > 1.9.0	          0.9.0	        >=3.6, <=3.9
       > 1.8.2	          0.8.2	        >=3.6, <=3.9
       > 1.8.1	          0.8.1	        >=3.6, <=3.9
       > 1.8.0	          0.8.0	        >=3.6, <=3.9
       > 1.7.1	          0.7.2	        >=3.6, <=3.9
       > 1.7.0	          0.7.0	        >=3.6, <=3.8
       > 1.6.0	          0.6.0	        >=3.6, <=3.8
       > 1.5.0	          0.5.0	        >=3.5, <=3.8
       > 1.4.0	          0.4.0	        ==2.7, >=3.5, <=3.8

    git

    • ssh-keygen -t rsa -b 2048 -C "3149827616@qq.com"
    • git config --global user.name "userName"
    • git config --global user.email "1@qq.com"

    macos安装tensorflow,适用于M1-12.5

    • arch -arm64 pip3 install tensorflow==2.13 numpy==1.24.3 - 清华
      • 普通方式会在numpy以及tf包中mach-o file, but is an incompatible architecture (have (x86_64), need (arm64e)))

    安装miniconda

    直接查看网页,注意cpu型号是否是m1、inter

    import pymysql
    pymysql.install_as_MySQLdb()

    虚拟机

    wsl子系统

    • 微软商店安装ubuntu
    • 打开连接安装使用wsl
    • pycahrm远程开发连接wsl
    • vscode安装wsl插件
    • jdk安装

    换源linux

    • 一键换源 wget http://fishros.com/install -O fishros && . fishros
    • sudo cp /etc/apt/sources.list /etc/apt/sources.list.bak
    • sudo vim /etc/apt/sources.list
    • 清空命令ggdG
    • 粘贴后保存:wq
    • sudo apt update

    安装miniconda

    换源conda

    • conda config --set show_channel_urls yes
    • 后面就用vscode打开.condarc

    nltk_data

    wsl2安装cuda支持

    gcc的安装Ubuntu18

    • 换源linux 18 aliyun
    deb http://mirrors.aliyun.com/ubuntu/ bionic main restricted universe multiverse
    deb http://mirrors.aliyun.com/ubuntu/ bionic-security main restricted universe multiverse
    deb http://mirrors.aliyun.com/ubuntu/ bionic-updates main restricted universe multiverse
    deb http://mirrors.aliyun.com/ubuntu/ bionic-proposed main restricted universe multiverse
    deb http://mirrors.aliyun.com/ubuntu/ bionic-backports main restricted universe multiverse
    deb-src http://mirrors.aliyun.com/ubuntu/ bionic main restricted universe multiverse
    deb-src http://mirrors.aliyun.com/ubuntu/ bionic-security main restricted universe multiverse
    deb-src http://mirrors.aliyun.com/ubuntu/ bionic-updates main restricted universe multiverse
    deb-src http://mirrors.aliyun.com/ubuntu/ bionic-proposed main restricted universe multiverse
    deb-src http://mirrors.aliyun.com/ubuntu/ bionic-backports main restricted universe multiverse
    
    • sudo apt-get update
    • sudo apt-get upgrade
    • sudo apt install gcc
    • essError: Command '['which', 'g++']' returned non-zero exit status
    • sudo apt-get install build-essential

    Hadoop 缺少的winutil.exe

    Spark-Hadoop安装使用流程

    • java安装目录为 Program Files 有空格可以改为PROGRA~1
    • %HADOOP_HOME%\bin\winutils.exe 文件下载于
    • 安装spark以及hadoop等流程
    1. jdk下载安装 下载地址
    • 打开Windows中的环境变量:
    • 创建JAVA_HOME:C:\PROGRA~1\Java\jdk1.8.0_202\
    • 创建CLASSPATH:%JAVA_HOME%\lib;%JAVA_HOME%\lib\tools.jar;%HADOOP_HOME%\bin\winutils.exe

    测试是否安装成功:打开cmd命令行,输入java -version

    1. Scala下载地址
    • 创建SCALA_HOME: C:\Program Files (x86)\scala

    测试是否安装成功:打开cmd命令行,输入scala -version

    1. spark2.4.4下载解压
    • SPARK_HOME:D:\spark-2.2.0-bin-hadoop2.7
    1. hadoop2.7.7下载解压
    • HADOOP_HOME:D:\hadoop-2.7.7
    1. Path添加:
    • %SPARK_HOME%\bin
    • %SCALA_HOME%\bin
    • %JAVA_HOME%\bin
    • %HADOOP_HOME%\bin

    数据库

    • 移除命令
      • mysqld.exe remove

    免安装版本

    • 5.1.50
    • mysqld.exe --install
    • 新建ini
    • mysqld --initialize-insecure --user=mysql
    • net start mysql
    • mysql -u root -p
    • update mysql.user set password='123456' where user='root' and Host='localhost';
    • flush privileges;
    • 注释掉skip
    • net stop mysql
    • net start mysql
    • 5.7
    • mysqld --initialize
    • mysqld install MySQL --defaults-file="C:\mysql-5.7.41-winx64\my.ini"
    • mysqld install MySQL --defaults-file="d:\mysql-5.7.41-winx64\my.ini"

    • net start mysql
    • net stop mysql

    • mysql -u root
    • use mysql

    • update mysql.user set authentication_string=password('123456') where user='root' and Host='localhost';
    • flush privileges;
    • mysql -u root -p
    • alter user 'root'@'localhost' identified by 'root';
    • use mysql
    • update mysql.user set authentication_string=password('123456') where user='root' and Host='localhost';
    • flush privileges;
    • 使用matplotlib出错
    Could not find the Qt platform plugin "windows" in ""
    This application failed to start because no Qt platform plugin could be initialized. Reinstalling the 
    • matplotlib.use('TKAgg')

    1

    项目简介

    当前项目暂无项目简介

    发行版本

    当前项目没有发行版本

    贡献者 1

    k54kdk @k54kdk

    开发语言

    • Nix 100.0 %