python嵌入式脚本_如何在python中刮取网页上的嵌入式脚本

我想用xpath来抹掉这句话.在全球进行的所有体育运动中,没有一项比美国的国家消遣棒球更具有诅咒和迷信了.

page = requests.get(url)

tree = html.fromstring(page.text)

feature_bullets = tree.xpath('//*[@id="iframeContent"]/div/text()')

print feature_bullets

以上代码未返回任何内容.原因是浏览器解释的xpath与源代码不同.但是我不知道如何从源代码获取xpath.

解决方法:

建立您要在网页上抓取的页面涉及很多事情.

至于描述,具体而言,底层HTML是在javascript函数内部构造的：

P.when('DynamicIframe').execute(function (DynamicIframe) {

var BookDescriptionIframe = null,

bookDescEncodedData = "%3Cdiv%3E%3CB%3EA%20Fantastic%20Anthology%20Combining%20the%20Love%20of%20Science%20Fiction%20with%20Our%20National%20Pastime%3C%2FB%3E%3CBR%3E%3CBR%3EOf%20all%20the%20sports%20played%20across%20the%20globe%2C%20none%20has%20more%20curses%20and%20superstitions%20than%20baseball%2C%20America%26%238217%3Bs%20national%20pastime.%3Cbr%3E%3CBR%3E%3CI%3EField%20of%20Fantasies%3C%2FI%3E%20delves%20right%20into%20that%20superstition%20with%20short%20stories%20written%20by%20several%20key%20authors%20about%20baseball%20and%20the%20supernatural.%20%20Here%20you%27ll%20encounter%20ghostly%20apparitions%20in%20the%20stands%2C%20a%20strangely%20charming%20vampire%20double-play%20combination%2C%20one%20fan%20who%20can%20call%20every%20shot%20and%20another%20who%20can%20see%20the%20past%2C%20a%20sad%20alternate-reality%20for%20the%20game%27s%20most%20famous%20player%2C%20unlikely%20appearances%20on%20the%20field%20by%20famous%20personalities%20from%20Stephen%20Crane%20to%20Fidel%20Castro%2C%20a