IT博客-yunshichen-随笔分类-Python2.5/2.6

Python 应用X: 工具集合

Chenyunshi — Wed, 27 Apr 2011 18:08:00 GMT

摘要: 简介记录自己做的一些稀奇古怪的程序. 工具一: 查找单词解释原理: http://dict.cn/ 提供了查词的引擎, 输入单词即可以得到解释. 所以这个程序只是做一些体力活. 代码如下: (有朋友反映复制之后出错. 若如此请移步到这里下载这个脚本: http://www.uudisc.com/user/diegoyun/file/4131948Code highlig... 阅读全文

Chenyunshi 2011-04-28 02:08 发表评论

Subprocess 操作, 如 Linux 下的shell 和 Windows 下的批处理

Chenyunshi — Wed, 27 Apr 2011 16:24:00 GMT

基本命令

东拼西凑查了好久, 才总算把这个命令补完全. 不废话, 直接上代码.

def exec_command(cmdlist,working_dir,view_result=False):
    if isinstance(cmdlist, str):
        cmdlist = [cmdlist]

    cmd_seperator = ";"
    import platform
    if platform.system() == "Windows":
        cmd_seperator = "&&"

    runCmd=""
    for cmd in cmdlist:
        if runCmd=="":
            runCmd = runCmd + cmd
        else:
            runCmd = runCmd + cmd_seperator + cmd

    p=subprocess.Popen(runCmd,shell=True,stdout=subprocess.PIPE,stdin=subprocess.PIPE,stderr=subprocess.PIPE,cwd=working_dir)
    out,err = p.communicate()
    result = {'out':out,'err':err,'returncode':str(p.returncode),'pid':str(p.pid)}
    if view_result:
        print "===== Printed result: "
        print "--> Run cmd: " + runCmd
        print "--> returncode: " + result["returncode"]
        print "--> out: " + result["out"]
        print "--> err: " + result["err"]

    return result

exec_command(["ls -l","uname -a"],".",True)

扩展功能1: CVS 操作

这个功能无甚神秘. 首先要安装有cvs, 其次要设置cvsroot. 最后, 你要时不时查查cvs的命令.

我承认拼凑这个程序还是费了不少时间, 所以有记下来的必要.

#!/usr/bin/python
# -*- coding: utf-8 -*-
'''
Created on Apr 28, 2011

@author: yunshichen@gmail.com
'''
import string
import subprocess
import platform

def exec_command(cmdlist,working_dir,view_result=False):
    if isinstance(cmdlist, str):
        cmdlist = [cmdlist]

    cmd_seperator = ";"
    if platform.system() == "Windows":
        cmd_seperator = "&&"

    runCmd=""
    for cmd in cmdlist:
        if runCmd=="":
            runCmd = runCmd + cmd
        else:
            runCmd = runCmd + cmd_seperator + cmd

    p=subprocess.Popen(runCmd,shell=True,stdout=subprocess.PIPE,stdin=subprocess.PIPE,stderr=subprocess.PIPE,cwd=working_dir)
    out,err = p.communicate()
    result = {'out':out,'err':err,'returncode':str(p.returncode),'pid':str(p.pid)}
    if view_result:
        print "===== Printed result: "
        print "--> Run cmd: " + runCmd
        print "--> returncode: " + result["returncode"]
        print "--> out: " + result["out"]
        print "--> err: " + result["err"]

    return result

class DPY_CVS():
    def __init__(self,cvs_cmd,cvs_root,is_debug=True):
        self.cvs_cmd = cvs_cmd
        self.cvs_root = cvs_root

    def checkout(self,working_dir,proj,opts=None):
        '''
        opts holds optional for checkout command. For example:

        {'r': diego_test_tag,'d':my_local_path}
        '''
        cmd_set_cvs_root = "set CVSROOT=" + self.cvs_root
        cmd_checkout = self.cvs_cmd + ' -q checkout ${optional_str} -P '+proj

        str=""
        if(opts <> None):
            for key in opts:
                str = str + " -"+key + " " + opts[key]

        cmd_checkout = string.Template(cmd_checkout).substitute({'optional_str':str})

        self.result = exec_command([cmd_set_cvs_root,cmd_checkout],working_dir)

    def tagFiles(self,working_dir,tagName,pathlist):

        cmd_set_cvs_root = "set CVSROOT=" + self.cvs_root
        cmd_tag_a_file = self.cvs_cmd + ' tag '+tagName+' ${cvs_file}'

        if isinstance(pathlist, str):
            pathlist = [pathlist]

        cmdlist = [cmd_set_cvs_root]
        for fpath in pathlist:
            if fpath.startswith("/"):
                fpath = fpath[1:]
            cmd_tag = string.Template(cmd_tag_a_file).substitute({'cvs_file':fpath})
            cmdlist.append(cmd_tag)

        self.result = exec_command(cmdlist,working_dir)

    def viewResult(self):
        r = self.result
        print "\n\n\n------------------ CVS run result: -----------"
        print "--->returncode: " + r["returncode"]
        print "out:\n" + r["out"]
        print "err:\n" + r["err"]

Chenyunshi 2011-04-28 00:24 发表评论

Python 数据库操作

Chenyunshi — Sun, 13 Feb 2011 16:02:00 GMT

打算把python连接db的例子都总结下来.

python连接sqllite

#!/usr/bin/python
# -*- coding: utf-8 -*-
'''
Created on 2/13/2011

@author: yunshichen@gmail.com
'''

'''

tutorial link: http://docs.python.org/py3k/library/sqlite3.html

SQLite is a C library that provides a lightweight disk-based database that doesn’t require a separate server process and allows accessing the database using a nonstandard variant of the SQL query language. Some applications can use SQLite for internal data storage. It’s also possible to prototype an application using SQLite and then port the code to a larger database such as PostgreSQL or Oracle.

sqlite3 was written by Gerhard Häring and provides a SQL interface compliant with the DB-API 2.0 specification described by PEP 249.

To use the module, you must first create a Connection object that represents the database. Here the data will be stored in the /tmp/example file:

'''

import sqlite3

DB_FILE = '/tmp/example'

def listData():
    conn = sqlite3.connect(DB_FILE)
    c = conn.cursor()

    print "Lists data.\n"
    sql = "select * from stocks order by price"
    c.execute(sql)
    for row in c:
        print(row)

    conn.commit()
    c.close()


def clearTableData():
    conn = sqlite3.connect(DB_FILE)
    c = conn.cursor()

    sql = "delete from stocks"
    c.execute(sql)

    print "All data are deleted.\n"
    conn.commit()
    c.close()

def insertData():
    conn = sqlite3.connect(DB_FILE)
    c = conn.cursor()

    insertData = "insert into stocks values ('2006-01-05','BUY','RHAT',100,35.14)"
    c.execute(insertData)

    # Never do this -- insecure!
    #    symbol = 'IBM'
    #    c.execute(" where symbol = '%s'" % symbol)
    # Do this instead
    #    t = (symbol,)
    #    c.execute('select * from stocks where symbol=?', t)

    insertSql = 'insert into stocks values (?,?,?,?,?)'
    for t in [('2006-03-28', 'BUY', 'IBM', 1000, 45.00),
              ('2006-04-05', 'BUY', 'MSOFT', 1000, 72.00),
              ('2006-04-06', 'SELL', 'IBM', 500, 53.00),
             ]:
        c.execute(insertSql, t)

    print "Set data into table stocks.\n"
    conn.commit()
    c.close()

def initTable():
    conn = sqlite3.connect(DB_FILE)
    c = conn.cursor()

    createTable = "create table stocks (date text, trans text, symbol text, qty real, price real)"
    c.execute(createTable)
    print "Created table stocks.\n"

    conn.commit()
    c.close()


'''
    运行例子:   ./sqllitetest.py -c init
'''
if __name__ =="__main__":

    from optparse import OptionParser
    parser = OptionParser()

    parser.add_option("-c", "--command", action="store",
                  dest="cmd",
                  default="init",
                  type="string",
                  help="Runs functions based on commands. Available commands are init,list,data,deleteAll ")

    options, args = parser.parse_args()

    cmd = options.cmd

    if(cmd=="init"):
        initTable()

    if(cmd=="deleteAll"):
        clearTableData()

    if(cmd=="data"):
        insertData()

    if(cmd=="list"):
        listData()

Chenyunshi 2011-02-14 00:02 发表评论

python 小程序, 查找todo选项, 促进自己更好的管理时间

Chenyunshi — Sun, 06 Feb 2011 13:42:00 GMT

想法&需求

1>在看代码的时候, 总会想: 这个api很好, 这段代码用法很好. 总结下来. 但当看完书的时候就忘了.
2>有时候会无聊, 无所事事. 浪费了一段时间后才想起, 其实可以做XX, YY.

解决办法

1>在看代码的时候用注释方式做标记, 记录下来.
2>用小程序遍历这些代码, 找出这些标记.
3>将这些项记录到excel里. 无聊的时候就打开这个excel看看有什么东西做.

todo的例子(用一些ide可以方便生成大部分注释)

------------------------------

-------------------------- todo sample begin
#todo_begin:
#item: 配置一个方便的调试 spring3 + hibernate 3 的教程
#estimate: 4-8h
#file: /media/dev/utopism2008/projects/python/dpytools/src/findtodo/FindToDo.py
#todo_end:

#todo_begin:
#item: 总结xlrt 和 xlwt 用法. 特别是 nrows 和写已有的excel
#estimate: 4h
#file: /media/dev/utopism2008/projects/python/dpytools/src/findtodo/FindToDo.py
#todo_end:
-------------------------------------------------------- todo sample end

程序源码:

  1 #! /usr/bin/python
  2 '''
  3 Created on Feb 6, 2011
  4
  5 1>Find todo string in every file read.
  6 2>Set this content into excel file. Every weekend I can check this file and make next plan based on these items.
  7
  8 @author: yunshichen@gamil.com
  9 '''
10 # -*- coding: utf8 -*-
11
12 import os
13 import ConfigParser
14
15 import xlrd
16 import xlutils.copy
17 import xlwt
18
19 ITEM_KEY = "#item:"
20 EST_KEY = "#estimate:"
21 FILE_PATH_KEY = "#file:"
22
23 '''
24 A typical sample of todo item in file:
25
26 #todo_begin:
27 #item: To summarize usage of Qt4 widget
28 #estimate: 5m
29 #file: /media/dev/utopism2008/projects/python/dpytools/src/findtodo/FindToDo.py
30 #todo_end:
31
32 '''
33 def findTodo(fpath,alist):
34     todo_begin = "todo_begin"
35     todo_end = "todo_end"
36     isFinding = False
37     fread = open(fpath,"r")
38     aitem = None
39     for line in fread:
40
41         if todo_begin in line:
42             isFinding = True
43             aitem = {}
44             continue
45
46         if todo_end in line:
47             isFinding = False
48             continue
49
50         if( isFinding == False):
51             continue
52
53         if mapKeyValue(aitem,ITEM_KEY,line):
54             continue
55
56         if mapKeyValue(aitem,EST_KEY,line):
57             continue
58
59         if mapKeyValue(aitem,FILE_PATH_KEY,line):
60             if FILE_PATH_KEY in line:
61                 alist.append(aitem)
62                 aitem = None
63                 print "--Find todo item in " + fpath + "\n"
64             continue
65
66
67     fread.close()
68
69
70 def mapKeyValue(item,key,line):
71     if key in line:
72         #test
73         print "key is:" + key + "\n"
74         item[key] = line[len(key):]
75         return True
76
77     return False
78
79
80 def findTodoFromFolder(alist,folder):
81     for  parent, dirnames, filenames  in  os.walk(folder):
82         for fname in filenames:
83             findTodo(os.path.join(parent, fname),alist)
84
85
86 def mainLogic():
87     configFileName = "config.txt"
88     cf = ConfigParser.ConfigParser();
89     cf.read(configFileName)
90
91     flist = cf.get("path", "folder_list").split(",")
92     itemlist = []
93     for folder  in flist:
94         findTodoFromFolder(itemlist,folder)
95
96     excelPath = cf.get("path", "excel_path")
97
98     mapItemIntoExcel(itemlist,excelPath)
99
100     print "\n---- OK -------- \n"
101
102 def createCellStype():
103     font = xlwt.Font()
104     font.wrap = xlwt.Alignment.WRAP_AT_RIGHT
105     style = xlwt.XFStyle()
106     style.font = font
107     return style
108
109
110 def mapItemIntoExcel(itemlist,excelPath):
111     try:
112
113         rb = xlrd.open_workbook(excelPath,formatting_info=True,on_demand=True)
114         wb = xlutils.copy.copy(rb)
115         sheet = wb.get_sheet(2)
116
117         row_index = len(sheet.rows)
118         row_index += 1
119
120         cellStyle = createCellStype()
121         for item in itemlist:
122             sheet.row(row_index).write(xlwt.Utils.col_by_name("A"),unicode(item[ITEM_KEY]),cellStyle )
123             sheet.row(row_index).write(xlwt.Utils.col_by_name("D"),item[EST_KEY] ,cellStyle)
124             sheet.row(row_index).write(xlwt.Utils.col_by_name("F"),"N"  ,cellStyle)
125             sheet.row(row_index).write(xlwt.Utils.col_by_name("H"),item[FILE_PATH_KEY]  ,cellStyle)
126             row_index += 1
127
128         wb.save(excelPath)
129
130     finally:
131         rb.release_resources
132
133 if __name__ =="__main__":
134     mainLogic();
135
136

程序和配置文件请在这里下载: http://www.uudisc.com/user/diegoyun/file/3880743

如何运行
1> sudo apt-get install python-xlrt python-xlwt
2> 到这个页面下载 xlutis : http://pypi.python.org/pypi/xlutils#downloads .
然后 sudo easy_install xlutils 该功能需要安装python 的 setuptools 功能. 如果没装,
ubuntu 会提示你安装.
3> 配置config.txt, 指定目录和excel路径
4> 运行 FindToDo.py

Chenyunshi 2011-02-06 21:42 发表评论

Python 读写 Excel

Chenyunshi — Mon, 15 Mar 2010 17:20:00 GMT

基本上, 这个网页已经说明一切了: http://pypi.python.org/pypi/xlrd

等有时间再把这个页面写漂亮,现在先记一些代码.

读Excel

先建个simple.xls

from xlrd import open_workbook

wb = open_workbook('simple.xls','rb')
for s in wb.sheets():
    print 'Sheet:',s.name
    for row in range(s.nrows):
        values=[]
        for col in range(s.ncols):
            values.append(s.cell(row,col).value)
        print ",".join(values)
    print

写Excel

from tempfile import TemporaryFile
from xlwt import Workbook

book = Workbook()
sheet1 = book.add_sheet('Sheet 1')
book.add_sheet('Sheet 2')
sheet1.write(0,0,'A1')
sheet1.write(0,1,'B1')

row1 = sheet1.row(1)
row1.write(0,'A2')
row1.write(1,'B2')

sheet1.col(0).width = 10000

sheet2 = book.get_sheet(1)
sheet2.row(0).write(0,'Sheet 2 A1')
sheet2.row(0).write(1,'Sheet 2 B1')
sheet2.flush_row_data()

sheet2.write(1,0,'Sheet 2 A3')
sheet2.col(0).width = 5000
sheet2.col(0).hidden = True

book.save('simple2.xls')
book.save(TemporaryFile())

Chenyunshi 2010-03-16 01:20 发表评论

python实用技巧 : Filtering os.walk

Chenyunshi — Sun, 07 Mar 2010 08:42:00 GMT

'''
Created on Mar 7, 2010

@author: Diego

需求: 得到某个目录下, 符合过滤条件的文件夹/文件.
实现: 将os.walk再次包装.

TODO: 不知道本程序的做法, 和传统的逐个目录列举的方法, 哪个效率更高. 待测试.

'''
import os
import os.path

os.path.sep = " / "
path = " /media/dev/project/google_codes/srgjs "
EXCLUDE_DIR_LIST = [ " .SVN " , " CVS " ]
EXCLUDE_FILE_LIST = [ " .CVSIGNORE " ]

def is_parent_exclude(parentPath,excludeDirList):
    ss = parentPath.split( " / " );
     for s in ss:
         if (s.upper() in excludeDirList):
             return True

     return False

def filter_walk(targetDirectory,excludeDirList,excludeFileExtList):
    dirList = []
    fileList = []
     for (parent, dirs, files) in os.walk(targetDirectory):

         for d in dirs:
             if (d.upper() in excludeDirList):
                 continue

             # To check if one of the parent dir should be excluded.
             if (is_parent_exclude(parent,excludeDirList)):
                 continue

            dirList.append(parent + " / " + d)


         for f in files:
             if (f.upper() in excludeFileExtList):
                 continue
             # To check if one of the parent dir should be excluded.
             if (is_parent_exclude(parent,excludeDirList)):
                 continue

            fileList.append(parent + " / " + f)

     return (dirList,fileList)

# test
dirs,files = filter_walk(path,EXCLUDE_DIR_LIST,EXCLUDE_FILE_LIST)

for d in dirs:
     print d

for f in files:
     print f

Chenyunshi 2010-03-07 16:42 发表评论

Python2.5/2.6实用教程:基础篇

Chenyunshi — Fri, 21 Nov 2008 09:53:00 GMT

介绍

本文方便有经验的程序员进入Python世界.本文适用于python2.5/2.6版本.

Deparecated:Python3 和 python2.x语法不同.如果你正在用python3,请参考新教程:http://www.cnitblog.com/yunshichen/archive/2009/04/01/55924.html

起步走

#! /usr/bin/python

a=2
b=3
c="test"
c=a+b
print "execution result: %i"%c

知识点

Python是动态语言,变量不须预先声明.
打印语句采用C风格

字符串和数字

但有趣的是,在javascript里我们会理想当然的将字符串和数字连接,因为是动态语言嘛.但在Python里有点诡异,如下:

#! /usr/bin/python

a=2
b="test"
c=a+b

运行这行程序会出错,提示你字符串和数字不能连接,于是只好用内置函数进行转换

#! /usr/bin/python

a=2
b="test"
c=str(a)+b
d="1111"
e=a+int(d)
#How to print multiply values
print "c is %s,e is %i" % (c,e)

知识点:

用int和str函数将字符串和数字进行转换
打印以#开头,而不是习惯的//
打印多个参数的方式

国际化

写腻了英文注释,我们要用中文!

#! /usr/bin/python
# -*- coding: utf8 -*-

print "上帝重返人间:马拉多纳出任阿根廷国家足球队主帅."

知识点:

加上字符集即可使用中文

列表

列表类似Javascript的数组,方便易用

#! /usr/bin/python
# -*- coding: utf8 -*-

#定义元组
word=['a','b','c','d','e','f','g']

#如何通过索引访问元组里的元素
a=word[2]
print "a is: "+a
b=word[1:3]
print "b is: "
print b # index 1 and 2 elements of word.
c=word[:2]
print "c is: "
print c # index 0 and 1 elements of word.
d=word[0:]
print "d is: "
print d # All elements of word.

#元组可以合并
e=word[:2]+word[2:]
print "e is: "
print e # All elements of word.
f=word[-1]
print "f is: "
print f # The last elements of word.
g=word[-4:-2]
print "g is: "
print g # index 3 and 4 elements of word.
h=word[-2:]
print "h is: "
print h # The last two elements.
i=word[:-2]
print "i is: "
print i # Everything except the last two characters
l=len(word)
print "Length of word is: "+ str(l)
print "Adds new element"
word.append('h')
print word

#删除元素
del word[0]
print word
del word[1:3]
print word

知识点:

列表长度是动态的,可任意添加删除元素.
用索引可以很方便访问元素,甚至返回一个子列表
更多方法请参考Python的文档

字典

#! /usr/bin/python

x={'a':'aaa','b':'bbb','c':12}
print x['a']
print x['b']
print x['c']

for key in x:
print "Key is %s and value is %s",(key,x[key])

keys=x.items();
print keys[0]
keys[0]='ddd'
print keys[0]

知识点:

将他当Java的Map来用即可.

字符串

比起C/C++,Python处理字符串的方式实在太让人感动了.把字符串当列表来用吧.

word="abcdefg"
a=word[2]
print "a is: "+a
b=word[1:3]
print "b is: "+b # index 1 and 2 elements of word.
c=word[:2]
print "c is: "+c # index 0 and 1 elements of word.
d=word[0:]
print "d is: "+d # All elements of word.
e=word[:2]+word[2:]
print "e is: "+e # All elements of word.
f=word[-1]
print "f is: "+f # The last elements of word.
g=word[-4:-2]
print "g is: "+g # index 3 and 4 elements of word.
h=word[-2:]
print "h is: "+h # The last two elements.
i=word[:-2]
print "i is: "+i # Everything except the last two characters
l=len(word)
print "Length of word is: "+ str(l)

不过要注意Asc和Unicode字符串的区别:

#! /usr/bin/python
# -*- coding: utf8 -*-

s=raw_input("输入你的中文名,按回车继续");
print "你的名字是 : " +s;

l=len(s)
print "你中文名字的长度是:"+str(l);
a=unicode(s,"utf8")
l=len(a)
print "对不起,刚才计算错误.我们应该用utf8来计算中文字符串的长度, \
你名字的长度应该是:"+str(l);

知识点:

用unicode函数进行转码

条件和循环语句

#! /usr/bin/python
x=int(raw_input("Please enter an integer:"))
if x<0:
    x=0
    print "Negative changed to zero"

elif x==0:
    print "Zero"

else:
    print "More"

# Loops List
a = ['cat', 'window', 'defenestrate']
for x in a:
    print x, len(x)

知识点:

条件和循环语句
如何得到控制台输入

函数

#! /usr/bin/python
# -*- coding: utf8 -*-

def sum(a,b):
return a+b

func = sum
r = func(5,6)
print r

# 提供默认值
def add(a,b=2):
return a+b
r=add(1)
print r
r=add(1,5)
print r

一个好用的函数

#! /usr/bin/python
# -*- coding: utf8 -*-

# The range() function
a =range(5,10)
print a
a = range(-2,-7)
print a
a = range(-7,-2)
print a
a = range(-2,-11,-3) # The 3rd parameter stands for step
print a

知识点:

Python 不用{}来控制程序结构,他强迫你用缩进来写程序,使代码清晰.
定义函数方便简单
方便好用的range函数

异常处理

#! /usr/bin/python
s=raw_input("Input your age:")
if s =="":
    raise Exception("Input must no be empty.")

try:
    i=int(s)
except ValueError:
    print "Could not convert data to an integer."
except:
    print "Unknown exception!"
else: # It is useful for code that must be executed if the try clause does not raise an exception
    print "You are %d" % i," years old"
finally: # Clean up action
    print "Goodbye!"

Chenyunshi 2008-11-21 17:53 发表评论

Python:文件操作技巧(File operation)

Chenyunshi — Mon, 11 Aug 2008 07:18:00 GMT

摘要: Python相关文件操作函数实例和说明阅读全文

Chenyunshi 2008-08-11 15:18 发表评论

备份文件的python脚本

Chenyunshi — Thu, 07 Aug 2008 16:48:00 GMT

摘要: 备份文件的python脚本，顺便学习学习语法阅读全文

Chenyunshi 2008-08-08 00:48 发表评论

实例教程:1小时学会Python

Chenyunshi — Thu, 08 May 2008 18:23:00 GMT

摘要: 适合有经验的程序员快速学会Python 阅读全文

Chenyunshi 2008-05-09 02:23 发表评论