Python词法分析器实现

最新推荐文章于 2024-06-27 21:52:01 发布

追_梦_者

最新推荐文章于 2024-06-27 21:52:01 发布

阅读量1.4w

点赞数 18

文章标签：编译原理-词法分析器

本文链接：https://blog.csdn.net/IT_DREAM_ER/article/details/53485583

版权

本文介绍了如何实现一个简单的Python词法分析器，包括词法分析器的状态转换图、总流程图、预处理程序和详细设计。通过这些内容，读者可以理解词法分析器的工作原理并查看具体的代码实现。

摘要由CSDN通过智能技术生成

简单Python词法分析器简单实现:

词法分析器状态转换图：

这里写图片描述

词法分析器总流程图：

这里写图片描述

预处理程序：

这里写图片描述

词法分析器：

这里写图片描述

词法分析器程序详细设计

这里写图片描述

详细代码实现:

#!/usr/bin/env python3.4
# coding=utf-8
import sys
import string

keywards = {}

# 关键字部分
keywards['False'] = 101
keywards['class'] = 102
keywards['finally'] = 103
keywards['is'] = 104
keywards['return'] = 105
keywards['None'] = 106
keywards['continue'] = 107
keywards['for'] = 108
keywards['lambda'] = 109
keywards['try'] = 110
keywards['True'] = 111
keywards['def'] = 112
keywards['from'] = 113
keywards['nonlocal'] = 114
keywards['while'] = 115
keywards['and'] = 116
keywards['del'] = 117
keywards['global'] = 118
keywards['not'] = 119
keywards['with'] = 120
keywards['as'] = 121
keywards['elif'] = 122
keywards['if'] = 123
keywards['or'] = 124
keywards['yield'] = 125
keywards['assert'] = 126
keywards['else'] = 127
keywards['import'] = 128
keywards['pass'] = 129
keywards['break'] = 130
keywards['except'] = 131
keywards['in'] = 132
keywards['raise'] = 133

# 符号
keywards['+'] = 201
keywards['-'] = 202
keywards['*'] = 203
keywards['/'] = 204
keywards['='] = 205
keywards[':'] = 206
keywards['<'] = 207
keywards['>'] = 208
keywards['%'] = 209
keywards['&'] = 210
keywards['!'] = 211
keywards[