python中的多cpu并行編程

第python中的多cpu并行編程目錄多cpu并行編程安裝使用submit函數(shù)定義多核cpu并行計(jì)算

多cpu并行編程

python多線程只能算并發(fā)，因?yàn)樗悄苁褂靡粋€(gè)cpu內(nèi)核python下pp包支持多cpu并行計(jì)算

安裝

pipinstallpp

使用

#-*-coding:UTF-8-*-

importmath,sys,time

importpp

defIsPrime(n):

"""返回n是否是素?cái)?shù)"""

ifnotisinstance(n,int):

raiseTypeError("argumentpassedtois_primeisnotof'int'type")

ifn2:

returnFalse

ifn==2:

returnTrue

max=int(math.ceil(math.sqrt(n)))

i=2

whilei=max:

ifn%i==0:

returnFalse

i+=1

returnTrue

defSumPrimes(n):

foriinxrange(15):

sum([xforxinxrange(2,n)ifIsPrime(x)])

"""計(jì)算從2-n之間的所有素?cái)?shù)之和"""

returnsum([xforxinxrange(2,n)ifIsPrime(x)])

inputs=(100000,100100,100200,100300,100400,100500,100600,100700)

#start_time=time.time()

#forinputininputs:

#printSumPrimes(input)

#print'單線程執(zhí)行，總耗時(shí)',time.time()-start_time,'s'

##tupleofallparallelpythonserverstoconnectwith

ppservers=()

#ppservers=("",)

iflen(sys.argv)1:

ncpus=int(sys.argv[1])

#Createsjobserverwithncpusworkers

job_server=pp.Server(ncpus,ppservers=ppservers)

else:

#Createsjobserverwithautomaticallydetectednumberofworkers

job_server=pp.Server(ppservers=ppservers)

print"pp可以用的工作核心線程數(shù)",job_server.get_ncpus(),"workers"

start_time=time.time()

jobs=[(input,job_server.submit(SumPrimes,(input,),(IsPrime,),("math",)))forinputininputs]#submit提交任務(wù)

forinput,jobinjobs:

print"Sumofprimesbelow",input,"is",job()#job()獲取方法執(zhí)行結(jié)果

print"多線程下執(zhí)行耗時(shí):",time.time()-start_time,"s"

job_server.print_stats()#輸出執(zhí)行信息

執(zhí)行結(jié)果

pp可以用的工作核心線程數(shù)4workers

Sumofprimesbelow100000is454396537

Sumofprimesbelow100100is454996777

Sumofprimesbelow100200is455898156

Sumofprimesbelow100300is456700218

Sumofprimesbelow100400is457603451

Sumofprimesbelow100500is458407033

Sumofprimesbelow100600is459412387

Sumofprimesbelow100700is460217613

多線程下執(zhí)行耗時(shí):15.4971420765s

Jobexecutionstatistics:

jobcount|%ofalljobs|jobtimesum|timeperjob|jobserver

8|100.00|60.9828|7.622844|local

Timeelapsedsinceservercreation15.4972219467

0activetasks,4cores

submit函數(shù)定義

defsubmit(self,func,args=(),depfuncs=(),modules=(),

callback=None,callbackargs=(),group='default',globals=None):

"""Submitsfunctiontotheexecutionqueue

func-functiontobeexecuted執(zhí)行的方法

args-tuplewithargumentsofthe'func'方法傳入的參數(shù)，使用元組

depfuncs-tuplewithfunctionswhichmightbecalledfrom'func'傳入自己寫的方法，元組

modules-tuplewithmodulenamestoimport傳入模塊

callback-callbackfunctionwhichwillbecalledwithargument

listequaltocallbackargs+(result,)

assoonascalculationisdone

callbackargs-additionalargumentsforcallbackfunction

group-jobgroup,isusedwhenwait(group)iscalledtowaitfor

jobsinagivengrouptofinish

globals-dictionaryfromwhichallmodules,functionsandclasses

willbeimported,forinstance:globals=globals()

"""

多核cpu并行計(jì)算

多進(jìn)程實(shí)現(xiàn)并行計(jì)算的簡單示例這里我們開兩個(gè)進(jìn)程，計(jì)算任務(wù)也簡潔明了

#多進(jìn)程

importmultiprocessingasmp

defjob(q,a,b):

print('aaa')

q.put(a**1000+b*1000)#把計(jì)算結(jié)果放到隊(duì)列

#多進(jìn)程

if__name__=='__main__':

q=mp.Queue()#一個(gè)隊(duì)列

p1=mp.Process(target=job,args=(q,100,200))

p2=mp.Process(target=job,args=(q,100,200))

p