Python代理

免費

云、[高可用全球免費庫](https://ip.jiangxianli.com/?page=3)、國內高匿、齊云、小幻、快、89免費、IP、小舒、西拉、seo方法、66免費

付費

阿布云、芝麻、閃臣（free 180min）、大象、全網、蘑菇、云、站大爺、蜻蜓

挺多的 付費的就不整那么多了
名字加上代理兩個字 搜

有了代理網站，就有了代理IP和埠，代理有全域模式和區域模式：全域嘛，就是你這個主機所有的請求都是通過你這個代理發出；區域就是你想一些請求或者指定一個請求用配置的代理，

一、全域模式（任意一種即可）

1、系統
Windows系統：按下win鍵，直接敲代理，進去代理設定下IP埠
Mac等帶終端的：環境變數增加兩行代理配置，如下

export http_proxy="http://127.0.0.1:1234"
export https_proxy="http://127.0.0.1:1234"

http://不能省略
2、python代碼參考
其實也是修改運行環境變數

import os
os.environ["http_proxy"] = "http://127.0.0.1:1231"
os.environ["https_proxy"] = "http://127.0.0.1:1231"

3、安裝tsocks后，編輯/etc/tsocks.conf，以SOCKS5代理為例：

server = 代理IP
server_port = 代理埠 
server_type = 5

再跑程式時，加上tsocks

tsocks python a.py

二、區域模式

1、創建代理池 這里以西刺代理為例

import re
import requests
from bs4 import BeautifulSoup

def get_proxy():
    #代理網站
    url='http://www.xiladaili.com/'
    #代理池(串列)
    proxies_li = []
    herder={
    'Upgrade-Insecure-Requests':'1',
    'Accept-Encoding':'gzip, deflate',
    'Accept-Language':'zh-CN,zh;q=0.9',
    'Accept':'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8',
    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36"
    }

    request=requests.get(url,headers=herder)
    bs = BeautifulSoup(request.text,'lxml')
    bresp = bs.find_all('td')
    for b in bresp:
        b = str(b)
        sb = re.compile('\d{3}\.\d{1,3}\.\d{1,3}\.\d{1,3}:\d{4}').findall(b)
        if len(sb) != 0:
            # print(sb[0])
            proxies_li.append(sb[0])
    return proxies_li

使用代理池的代理

li = get_proxy()
proxy = random.choice(li)
proxies = {"http": "http://" + str(proxy)}

print(proxies)
print(requests.get('https://www.baidu.com', headers=herder, proxies=proxies).content)

三、實用代碼塊

1、user-agent

USER_AGENT_LIST = [
    "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/22.0.1207.1 Safari/537.1",
    "Mozilla/5.0 (X11; CrOS i686 2268.111.0) AppleWebKit/536.11 (KHTML, like Gecko) Chrome/20.0.1132.57 Safari/536.11",
    "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.6 (KHTML, like Gecko) Chrome/20.0.1092.0 Safari/536.6",
    "Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.6 (KHTML, like Gecko) Chrome/20.0.1090.0 Safari/536.6",
    "Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/19.77.34.5 Safari/537.1",
    "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.9 Safari/536.5",
    "Mozilla/5.0 (Windows NT 6.0) AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.36 Safari/536.5",
    "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1063.0 Safari/536.3",
    "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1063.0 Safari/536.3",
    "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_0) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1063.0 Safari/536.3",
    "Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1062.0 Safari/536.3",
    "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1062.0 Safari/536.3",
    "Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.1 Safari/536.3",
    "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.1 Safari/536.3",
    "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.1 Safari/536.3",
    "Mozilla/5.0 (Windows NT 6.2) AppleWebKit/536.3 (KHTML, like Gecko) Chrome/19.0.1061.0 Safari/536.3",
    "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.24 (KHTML, like Gecko) Chrome/19.0.1055.1 Safari/535.24",
    "Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/535.24 (KHTML, like Gecko) Chrome/19.0.1055.1 Safari/535.24"
]

2、判斷代理IP是否可用

import time
import requests

def proxy_isable(ipt):
    time.sleep(1)
    herder={
    'Upgrade-Insecure-Requests':'1',
    'Accept-Encoding':'gzip, deflate',
    'Accept-Language':'zh-CN,zh;q=0.9',
    'Accept':'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8',
    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36"
    }

    url='https://www.baidu.com'
    proxies = { "http": "http://"+str(ipt) }
    request=requests.get(url,headers=herder,proxies=proxies)
    if request.status_code==200:
        print('可用代理'+ipt)
    else:
        print('不可用代理'+ipt)