NNLM模型实战
NNLM（Neural Network Language Model）是一种基于神经网络的语言模型，用于捕捉语言中的语义和句法关系。与传统的统计语言模型相比，NNLM 能更好地处理稀疏数据问题，并且能够捕捉到更复杂的语言结构。
- NNLM 模型介绍
NNLM 模型通常包括以下几个部分：
输入层（Input Layer）：接受一个词或一段文本作为输入，通常使用词嵌入（Word Embeddings）来表示输入的词。
嵌入层（Embedding Layer）：将离散的词语转换为连续的向量表示，这些向量捕捉了词语的语义信息。
隐藏层（Hidden Layer）：一个或多个隐藏层，用于捕捉输入词语之间的复杂关系。常用的隐藏层有全连接层（Fully Connected Layer）和循环神经网络层（Recurrent Neural Network Layer）。
输出层（Output Layer）：预测下一个词或一段文本的概率分布。
预训练模型
from tensorflow.keras.preprocessing.text import Tokenizer
from tensorflow.keras.preprocessing import sequence
import numpy as np
from tensorflow.keras.models import Model
from tensorflow.keras.layers import Concatenate,Reshape,Embedding,Dense
from tensorflow.keras import Input
import tensorflow as tf
from tensorflow import keras
with open('nnlm/a.txt','r') as f:
doc = f.readlines()
doc
["Project Gutenberg's Alice's Adventures in Wonderland, by Lewis Carroll\n",
'\n',
'This eBook is for the use of anyone anywhere at no cost and with\n',
'almost no restrictions whatsoever. You may copy it, give it away or\n',
're-use it under the terms of the Project Gutenberg License included\n',
'with this eBook or online at www.gutenberg.org\n',
'\n',
'\n',
"Title: Alice's Adventures in Wonderland\n",
'Alice was beginning to get very tired of sitting by her sister on the\n',
'bank, and of having nothing to do: once or twice she had peeped into the\n',
'book her sister was reading, but it had no pictures or conversations in\n',
"it, 'and what is the use of a book,' thought Alice 'without pictures or\n",
"conversations?'\n",
'\n',
'So she was considering in her own mind (as well as she could, for the\n',
'hot day made her feel very sleepy and stupid), whether the pleasure\n',
'of making a daisy-chain would be worth the trouble of getting up and\n',
'picking the daisies, when suddenly a White Rabbit with pink eyes ran\n',
'close by her.\n',
'\n',
'There was nothing so VERY remarkable in that; nor did Alice think it so\n',
"VERY much out of the way to hear the Rabbit say to itself, 'Oh dear!\n",
"Oh dear! I shall be late!' (when she thought it over afterwards, it\n",
'occurred to her that she ought to have wondered at this, but at the time\n',
'it all seemed quite natural); but when the Rabbit actually TOOK A WATCH\n',
'OUT OF ITS WAISTCOAT-POCKET, and looked at it, and then hurried on,\n',
'Alice started to her feet, for it flashed across her mind that she had\n',
'never before seen a rabbit with either a waistcoat-pocket, or a watch\n',
'to take out of it, and burning with curiosity, she ran across the field\n',
'after it, and fortunately was just in time to see it pop down a large\n',
'rabbit-hole under the hedge.\n',
'\n',
'In another moment down went Alice after it, never once considering how\n',
'in the world she was to get out again.\n',
'\n',
'The rabbit-hole went straight on like a tunnel for some way, and then\n',
'dipped suddenly down, so suddenly that Alice had not a moment to think\n',
'about stopping herself before she found herself falling down a very deep\n',
'well.\n',
'\n',
'Either the well was very deep, or she fell very slowly, for she had\n',
'plenty of time as she went down to look about her and to wonder what was\n',
'going to happen next. First, she tried to look down and make out what\n',
'she was coming to, but it was too dark to see anything; then she\n',
'looked at the sides of the well, and noticed that they were filled with\n',
'cupboards and book-shelves; here and there she saw maps and pictures\n',
'hung upon pegs. She took down a jar from one of the shelves as\n',
"she passed; it was labelled 'ORANGE MARMALADE', but to her great\n",
'disappointment it was empty: she did not like to drop the jar for fear\n',
'of killing somebody, so managed to put it into one of the cupboards as\n',
'she fell past it.\n',
'\n',
"'Well!' thought Alice to herself, 'after such a fall as this, I shall\n",
"think nothing of tumbling down stairs! How brave they'll all think me at\n",
"home! Why, I wouldn't say anything about it, even if I fell off the top\n",
"of the house!' (Which was very likely true.)\n",
'\n',
"Down, down, down. Would the fall NEVER come to an end! 'I wonder how\n",
"many miles I've fallen by this time?' she said aloud. 'I must be getting\n",
'somewhere near the centre of the earth. Let me see: that would be four\n',
"thousand miles down, I think--' (for, you see, Alice had learnt several\n",
'things of this sort in her lessons in the schoolroom, and though this\n',
'was not a VERY good opportunity for showing off her knowledge, as there\n',
'was no one to listen to her, still it was good practice to say it over)\n',
"'--yes, that's about the right distance--but then I wonder what Latitude\n",
"or Longitude I've got to?' (Alice had no idea what Latitude was, or\n",
'Longitude either, but thought they were nice grand words to say.)\n',
'\n',
"Presently she began again. 'I wonder if I shall fall right THROUGH the\n",
"earth! How funny it'll seem to come out among the people that walk with\n",
"their heads downward! The Antipathies, I think--' (she was rather glad\n",
"there WAS no one listening, this time, as it didn't sound at all the\n",
"right word) '--but I shall have to ask them what the name of the country\n",
"is, you know. Please, Ma'am, is this New Zealand or Australia?' (and\n",
"she tried to curtsey as she spoke--fancy CURTSEYING as you're falling\n",
"through the air! Do you think you could manage it?) 'And what an\n",
"ignorant little girl she'll think me for asking! No, it'll never do to\n",
"ask: perhaps I shall see it written up somewhere.'\n",
'\n',
'Down, down, down. There was nothing else to do, so Alice soon began\n',
"talking again. 'Dinah'll miss me very much to-night, I should think!'\n",
"(Dinah was the cat.) 'I hope they'll remember her saucer of milk at\n",
'tea-time. Dinah my dear! I wish you were down here with me! There are no\n',
"mice in the air, I'm afraid, but you might catch a bat, and that's very\n",
"like a mouse, you know. But do cats eat bats, I wonder?' And here Alice\n",
'began to get rather sleepy, and went on saying to herself, in a dreamy\n',
"sort of way, 'Do cats eat bats? Do cats eat bats?' and sometimes, 'Do\n",
"bats eat cats?' for, you see, as she couldn't answer either question,\n",
"it didn't much matter which way she put it. She felt that she was dozing\n",
'off, and had just begun to dream that she was walking hand in hand with\n',
"Dinah, and saying to her very earnestly, 'Now, Dinah, tell me the truth:\n",
"did you ever eat a bat?' when suddenly, thump! thump! down she came upon\n",
'a heap of sticks and dry leaves, and the fall was over.\n',
'\n',
'Alice was not a bit hurt, and she jumped up on to her feet in a moment:\n',
'she looked up, but it was all dark overhead; before her was another\n',
'long passage, and the White Rabbit was still in sight, hurrying down it.\n',
'There was not a moment to be lost: away went Alice like the wind, and\n',
"was just in time to hear it say, as it turned a corner, 'Oh my ears\n",
"and whiskers, how late it's getting!' She was close behind it when she\n",
'turned the corner, but the Rabbit was no longer to be seen: she found\n',
'herself in a long, low hall, which was lit up by a row of lamps hanging\n',
'from the roof.\n',
'\n',
'There were doors all round the hall, but they were all locked; and when\n',
'Alice had been all the way down one side and up the other, trying every\n',
'door, she walked sadly down the middle, wondering how she was ever to\n',
'get out again.\n',
'\n',
'Suddenly she came upon a little three-legged table, all made of solid\n',
"glass; there was nothing on it except a tiny golden key, and Alice's\n",
'first thought was that it might belong to one of the doors of the hall;\n',
'but, alas! either the locks were too large, or the key was too small,\n',
'but at any rate it would not open any of them. However, on the second\n',
'time round, she came upon a low curtain she had not noticed before, and\n',
'behind it was a little door about fifteen inches high: she tried the\n',
'little golden key in the lock, and to her great delight it fitted!\n',
'\n',
'Alice opened the door and found that it led into a small passage, not\n',
'much larger than a rat-hole: she knelt down and looked along the passage\n',
'into the loveliest garden you ever saw. How she longed to get out of\n',
'that dark hall, and wander about among those beds of bright flowers and\n',
'those cool fountains, but she could not even get her head through the\n',
"doorway; 'and even if my head would go through,' thought poor Alice, 'it\n",
'would be of very little use without my shoulders. Oh, how I wish I could\n',
"shut up like a telescope! I think I could, if I only knew how to begin.'\n",
'For, you see, so many out-of-the-way things had happened lately,\n',
'that Alice had begun to think that very few things indeed were really\n',
'impossible.\n',
'\n',
'There seemed to be no use in waiting by the little door, so she went\n',
'back to the table, half hoping she might find another key on it, or at\n',
'any rate a book of rules for shutting people up like telescopes: this\n',
"time she found a little bottle on it, ('which certainly was not here\n",
"before,' said Alice,) and round the neck of the bottle was a paper\n",
"label, with the words 'DRINK ME' beautifully printed on it in large\n",
'letters.\n',
'\n',
"It was all very well to say 'Drink me,' but the wise little Alice was\n",
"not going to do THAT in a hurry. 'No, I'll look first,' she said, 'and\n",
'see whether it\'s marked "poison" or not\'; for she had read several nice\n',
'little histories about children who had got burnt, and eaten up by wild\n',
'beasts and other unpleasant things, all because they WOULD not remember\n',
'the simple rules their friends had taught them: such as, that a red-hot\n',
'poker will burn you if you hold it too long; and that if you cut your\n',
'finger VERY deeply with a knife, it usually bleeds; and she had never\n',
"forgotten that, if you drink much from a bottle marked 'poison,' it is\n",
'almost certain to disagree with you, sooner or later.\n',
'\n',
"However, this bottle was NOT marked 'poison,' so Alice ventured to taste\n",
'it, and finding it very nice, (it had, in fact, a sort of mixed flavour\n',
'of cherry-tart, custard, pine-apple, roast turkey, toffee, and hot\n',
'buttered toast,) she very soon finished it off.\n',
'\n',
' * * * * * * *\n',
'\n',
' * * * * * *\n',
'\n',
' * * * * * * *\n',
'\n',
"'What a curious feeling!' said Alice; 'I must be shutting up like a\n",
"telescope.'\n",
'\n',
'And so it was indeed: she was now only ten inches high, and her face\n',
'brightened up at the thought that she was now the right size for going\n',
'through the little door into that lovely garden. First, however, she\n',
'waited for a few minutes to see if she was going to shrink any further:\n',
"she felt a little nervous about this; 'for it might end, you know,' said\n",
"Alice to herself, 'in my going out altogether, like a candle. I wonder\n",
"what I should be like then?' And she tried to fancy what the flame of a\n",
'candle is like after the candle is blown out, for she could not remember\n',
'ever having seen such a thing.\n',
'\n',
'After a while, finding that nothing more happened, she decided on going\n',
'into the garden at once; but, alas for poor Alice! when she got to the\n',
'door, she found she had forgotten the little golden key, and when she\n',
'went back to the table for it, she found she could not possibly reach\n',
'it: she could see it quite plainly through the glass, and she tried her\n',
'best to climb up one of the legs of the table, but it was too slippery;\n',
'and when she had tired herself out with trying, the poor little thing\n',
'sat down and cried.\n',
'\n',
"'Come, there's no use in crying like that!' said Alice to herself,\n",
"rather sharply; 'I advise you to leave off this minute!' She generally\n",
'gave herself very good advice, (though she very seldom followed it),\n',
'and sometimes she scolded herself so severely as to bring tears into\n',
'her eyes; and once she remembered trying to box her own ears for having\n',
'cheated herself in a game of croquet she was playing against herself,\n',
'for this curious child was very fond of pretending to be two people.\n',
"'But it's no use now,' thought poor Alice, 'to pretend to be two people!\n",
"Why, there's hardly enough of me left to make ONE respectable person!'\n",
'\n',
'Soon her eye fell on a little glass box that was lying under the table:\n',
'she opened it, and found in it a very small cake, on which the words\n',
"'EAT ME' were beautifully marked in currants. 'Well, I'll eat it,' said\n",
"Alice, 'and if it makes me grow larger, I can reach the key; and if it\n",
"makes me grow smaller, I can creep under the door; so either way I'll\n",
"get into the garden, and I don't care which happens!'\n",
'\n',
"She ate a little bit, and said anxiously to herself, 'Which way? Which\n",
"way?', holding her hand on the top of her head to feel which way it was\n",
'growing, and she was quite surprised to find that she remained the same\n',
'size: to be sure, this generally happens when one eats cake, but Alice\n',
'had got so much into the way of expecting nothing but out-of-the-way\n',
'things to happen, that it seemed quite dull and stupid for life to go on\n',
'in the common way.\n',
'\n',
'So she set to work, and very soon finished off the cake.\n',
'\n',
' * * * * * * *\n',
'\n',
' * * * * * *\n',
'\n',
' * * * * * * *\n',
'\n',
'\n',
'\n',
'\n',
'CHAPTER II. The Pool of Tears\n',
'\n',
"'Curiouser and curiouser!' cried Alice (she was so much surprised, that\n",
"for the moment she quite forgot how to speak good English); 'now I'm\n",
"opening out like the largest telescope that ever was! Good-bye, feet!'\n",
'(for when she looked down at her feet, they seemed to be almost out of\n',
"sight, they were getting so far off). 'Oh, my poor little feet, I wonder\n",
"who will put on your shoes and stockings for you now, dears? I'm sure\n",
"_I_ shan't be able! I shall be a great deal too far off to trouble\n",
'myself about you: you must manage the best way you can;--but I must be\n',
"kind to them,' thought Alice, 'or perhaps they won't walk the way I want\n",
"to go! Let me see: I'll give them a new pair of boots every Christmas.'\n",
'\n',
"And she went on planning to herself how she would manage it. 'They must\n",
"go by the carrier,' she thought; 'and how funny it'll seem, sending\n",
"presents to one's own feet! And how odd the directions will look!\n",
'\n',
" ALICE'S RIGHT FOOT, ESQ.\n",
' HEARTHRUG,\n',
' NEAR THE FENDER,\n',
" (WITH ALICE'S LOVE).\n",
'\n',
"Oh dear, what nonsense I'm talking!'\n",
'\n',
'Just then her head struck against the roof of the hall: in fact she was\n',
'now more than nine feet high, and she at once took up the little golden\n',
'key and hurried off to the garden door.\n',
'\n',
'Poor Alice! It was as much as she could do, lying down on one side, to\n',
'look through into the garden with one eye; but to get through was more\n',
'hopeless than ever: she sat down and began to cry again.\n',
'\n',
"'You ought to be ashamed of yourself,' said Alice, 'a great girl like\n",
"you,' (she might well say this), 'to go on crying in this way! Stop this\n",
"moment, I tell you!' But she went on all the same, shedding gallons of\n",
'tears, until there was a large pool all round her, about four inches\n',
'deep and reaching half down the hall.\n',
'\n',
'After a time she heard a little pattering of feet in the distance, and\n',
'she hastily dried her eyes to see what was coming. It was the White\n',
'Rabbit returning, splendidly dressed, with a pair of white kid gloves in\n',
'one hand and a large fan in the other: he came trotting along in a great\n',
"hurry, muttering to himself as he came, 'Oh! the Duchess, the Duchess!\n",
"Oh! won't she be savage if I've kept her waiting!' Alice felt so\n",
'desperate that she was ready to ask help of any one; so, when the Rabbit\n',
"came near her, she began, in a low, timid voice, 'If you please, sir--'\n",
'The Rabbit started violently, dropped the white kid gloves and the fan,\n',
'and skurried away into the darkness as hard as he could go.\n',
'\n',
'Alice took up the fan and gloves, and, as the hall was very hot, she\n',
"kept fanning herself all the time she went on talking: 'Dear, dear! How\n",
'queer everything is to-day! And yesterday things went on just as usual.\n',
"I wonder if I've been changed in the night? Let me think: was I the\n",
'same when I got up this morning? I almost think I can remember feeling a\n',
"little different. But if I'm not the same, the next question is, Who\n",
"in the world am I? Ah, THAT'S the great puzzle!' And she began thinking\n",
'over all the children she knew that were of the same age as herself, to\n',
'see if she could have been changed for any of them.\n',
'\n',
"'I'm sure I'm not Ada,' she said, 'for her hair goes in such long\n",
"ringlets, and mine doesn't go in ringlets at all; and I'm sure I can't\n",
'be Mabel, for I know all sorts of things, and she, oh! she knows such a\n',
"very little! Besides, SHE'S she, and I'm I, and--oh dear, how puzzling\n",
"it all is! I'll try if I know all the things I used to know. Let me\n",
'see: four times five is twelve, and four times six is thirteen, and\n',
'four times seven is--oh dear! I shall never get to twenty at that rate!\n',
"However, the Multiplication Table doesn't signify: let's try Geography.\n",
'London is the capital of Paris, and Paris is the capital of Rome, and\n',
"Rome--no, THAT'S all wrong, I'm certain! I must have been changed for\n",
'Mabel! I\'ll try and say "How doth the little--"\' and she crossed her\n',
'hands on her lap as if she were saying lessons, and began to repeat it,\n',
'but her voice sounded hoarse and strange, and the words did not come the\n',
'same as they used to do:--\n',
'\n',
" 'How doth the little crocodile\n",
' Improve his shining tail,\n',
' And pour the waters of the Nile\n',
' On every golden scale!\n',
'\n',
" 'How cheerfully he seems to grin,\n",
' How neatly spread his claws,\n',
' And welcome little fishes in\n',
" With gently smiling jaws!'\n",
'\n',
"'I'm sure those are not the right words,' said poor Alice, and her eyes\n",
"filled with tears again as she went on, 'I must be Mabel after all, and\n",
'I shall have to go and live in that poky little house, and have next to\n',
"no toys to play with, and oh! ever so many lessons to learn! No, I've\n",
"made up my mind about it; if I'm Mabel, I'll stay down here! It'll be no\n",
'use their putting their heads down and saying "Come up again, dear!" I\n',
'shall only look up and say "Who am I then? Tell me that first, and then,\n',
"if I like being that person, I'll come up: if not, I'll stay down here\n",
'till I\'m somebody else"--but, oh dear!\' cried Alice, with a sudden burst\n',
"of tears, 'I do wish they WOULD put their heads down! I am so VERY tired\n",
"of being all alone here!'\n",
'\n',
'As she said this she looked down at her hands, and was surprised to see\n',
"that she had put on one of the Rabbit's little white kid gloves while\n",
"she was talking. 'How CAN I have done that?' she thought. 'I must\n",
"be growing small again.' She got up and went to the table to measure\n",
'herself by it, and found that, as nearly as she could guess, she was now\n',
'about two feet high, and was going on shrinking rapidly: she soon found\n',
'out that the cause of this was the fan she was holding, and she dropped\n',
'it hastily, just in time to avoid shrinking away altogether.\n',
'\n',
"'That WAS a narrow escape!' said Alice, a good deal frightened at the\n",
"sudden change, but very glad to find herself still in existence; 'and\n",
"now for the garden!' and she ran with all speed back to the little door:\n",
'but, alas! the little door was shut again, and the little golden key was\n',
"lying on the glass table as before, 'and things are worse than ever,'\n",
"thought the poor child, 'for I never was so small as this before, never!\n",
"And I declare it's too bad, that it is!'\n",
'\n',
'As she said these words her foot slipped, and in another moment, splash!\n',
'she was up to her chin in salt water. Her first idea was that she\n',
"had somehow fallen into the sea, 'and in that case I can go back by\n",
"railway,' she said to herself. (Alice had been to the seaside once in\n",
'her life, and had come to the general conclusion, that wherever you go\n',
'to on the English coast you find a number of bathing machines in the\n',
'sea, some children digging in the sand with wooden spades, then a row\n',
'of lodging houses, and behind them a railway station.) However, she soon\n',
'made out that she was in the pool of tears which she had wept when she\n',
'was nine feet high.\n',
'\n',
"'I wish I hadn't cried so much!' said Alice, as she swam about, trying\n",
"to find her way out. 'I shall be punished for it now, I suppose, by\n",
'being drowned in my own tears! That WILL be a queer thing, to be sure!\n',
"However, everything is queer to-day.'\n",
'\n',
'Just then she heard something splashing about in the pool a little way\n',
'off, and she swam nearer to make out what it was: at first she thought\n',
'it must be a walrus or hippopotamus, but then she remembered how small\n',
'she was now, and she soon made out that it was only a mouse that had\n',
'slipped in like herself.\n',
'\n',
"'Would it be of any use, now,' thought Alice, 'to speak to this mouse?\n",
'Everything is so out-of-the-way down here, that I should think very\n',
"likely it can talk: at any rate, there's no harm in trying.' So she\n",
"began: 'O Mouse, do you know the way out of this pool? I am very tired\n",
"of swimming about here, O Mouse!' (Alice thought this must be the right\n",
'way of speaking to a mouse: she had never done such a thing before, but\n',
"she remembered having seen in her brother's Latin Grammar, 'A mouse--of\n",
"a mouse--to a mouse--a mouse--O mouse!') The Mouse looked at her rather\n",
'inquisitively, and seemed to her to wink with one of its little eyes,\n',
'but it said nothing.\n',
'\n',
"'Perhaps it doesn't understand English,' thought Alice; 'I daresay it's\n",
"a French mouse, come over with William the Conqueror.' (For, with all\n",
'her knowledge of history, Alice had no very clear notion how long ago\n',
"anything had happened.) So she began again: 'Ou est ma chatte?' which\n",
'was the first sentence in her French lesson-book. The Mouse gave a\n',
'sudden leap out of the water, and seemed to quiver all over with fright.\n',
"'Oh, I beg your pardon!' cried Alice hastily, afraid that she had hurt\n",
"the poor animal's feelings. 'I quite forgot you didn't like cats.'\n",
'\n',
"'Not like cats!' cried the Mouse, in a shrill, passionate voice. 'Would\n",
"YOU like cats if you were me?'\n",
'\n',
"'Well, perhaps not,' said Alice in a soothing tone: 'don't be angry\n",
"about it. And yet I wish I could show you our cat Dinah: I think you'd\n",
'take a fancy to cats if you could only see her. She is such a dear quiet\n',
"thing,' Alice went on, half to herself, as she swam lazily about in the\n",
"pool, 'and she sits purring so nicely by the fire, licking her paws and\n",
"washing her face--and she is such a nice soft thing to nurse--and she's\n",
"such a capital one for catching mice--oh, I beg your pardon!' cried\n",
'Alice again, for this time the Mouse was bristling all over, and she\n',
"felt certain it must be really offended. 'We won't talk about her any\n",
"more if you'd rather not.'\n",
'\n',
"'We indeed!' cried the Mouse, who was trembling down to the end of his\n",
"tail. 'As if I would talk on such a subject! Our family always HATED\n",
"cats: nasty, low, vulgar things! Don't let me hear the name again!'\n",
'\n',
"'I won't indeed!' said Alice, in a great hurry to change the subject of\n",
"conversation. 'Are you--are you fond--of--of dogs?' The Mouse did not\n",
"answer, so Alice went on eagerly: 'There is such a nice little dog near\n",
'our house I should like to show you! A little bright-eyed terrier, you\n',
"know, with oh, such long curly brown hair! And it'll fetch things when\n",
"you throw them, and it'll sit up and beg for its dinner, and all sorts\n",
"of things--I can't remember half of them--and it belongs to a farmer,\n",
"you know, and he says it's so useful, it's worth a hundred pounds! He\n",
"says it kills all the rats and--oh dear!' cried Alice in a sorrowful\n",
"tone, 'I'm afraid I've offended it again!' For the Mouse was swimming\n",
'away from her as hard as it could go, and making quite a commotion in\n',
'the pool as it went.\n',
'\n',
"So she called softly after it, 'Mouse dear! Do come back again, and we\n",
"won't talk about cats or dogs either, if you don't like them!' When the\n",
'Mouse heard this, it turned round and swam slowly back to her: its\n',
'face was quite pale (with passion, Alice thought), and it said in a low\n',
"trembling voice, 'Let us get to the shore, and then I'll tell you my\n",
"history, and you'll understand why it is I hate cats and dogs.'\n",
'\n',
'It was high time to go, for the pool was getting quite crowded with the\n',
'birds and animals that had fallen into it: there were a Duck and a Dodo,\n',
'a Lory and an Eaglet, and several other curious creatures. Alice led the\n',
'way, and the whole party swam to the shore.\n',
'\n',
'\n',
'\n',
'\n',
'CHAPTER III. A Caucus-Race and a Long Tale\n',
'\n',
'They were indeed a queer-looking party that assembled on the bank--the\n',
'birds with draggled feathers, the animals with their fur clinging close\n',
'to them, and all dripping wet, cross, and uncomfortable.\n',
'\n',
'The first question of course was, how to get dry again: they had a\n',
'consultation about this, and after a few minutes it seemed quite natural\n',
'to Alice to find herself talking familiarly with them, as if she had\n',
'known them all her life. Indeed, she had quite a long argument with the\n',
"Lory, who at last turned sulky, and would only say, 'I am older than\n",
"you, and must know better'; and this Alice would not allow without\n",
'knowing how old it was, and, as the Lory positively refused to tell its\n',
'age, there was no more to be said.\n',
'\n',
'At last the Mouse, who seemed to be a person of authority among them,\n',
"called out, 'Sit down, all of you, and listen to me! I'LL soon make you\n",
"dry enough!' They all sat down at once, in a large ring, with the Mouse\n",
'in the middle. Alice kept her eyes anxiously fixed on it, for she felt\n',
'sure she would catch a bad cold if she did not get dry very soon.\n',
'\n',
"'Ahem!' said the Mouse with an important air, 'are you all ready? This\n",
'is the driest thing I know. Silence all round, if you please! "William\n',
'the Conqueror, whose cause was favoured by the pope, was soon submitted\n',
'to by the English, who wanted leaders, and had been of late much\n',
'accustomed to usurpation and conquest. Edwin and Morcar, the earls of\n',
'Mercia and Northumbria--"\'\n',
'\n',
"'Ugh!' said the Lory, with a shiver.\n",
'\n',
"'I beg your pardon!' said the Mouse, frowning, but very politely: 'Did\n",
"you speak?'\n",
'\n',
"'Not I!' said the Lory hastily.\n",
'\n',
'\'I thought you did,\' said the Mouse. \'--I proceed. "Edwin and Morcar,\n',
'the earls of Mercia and Northumbria, declared for him: and even Stigand,\n',
'the patriotic archbishop of Canterbury, found it advisable--"\'\n',
'\n',
"'Found WHAT?' said the Duck.\n",
'\n',
"'Found IT,' the Mouse replied rather crossly: 'of course you know what\n",
'"it" means.\'\n',
'\n',
'\'I know what "it" means well enough, when I find a thing,\' said the\n',
"Duck: 'it's generally a frog or a worm. The question is, what did the\n",
"archbishop find?'\n",
'\n',
'The Mouse did not notice this question, but hurriedly went on, \'"--found\n',
'it advisable to go with Edgar Atheling to meet William and offer him the\n',
"crown. William's conduct at first was moderate. But the insolence of his\n",
'Normans--" How are you getting on now, my dear?\' it continued, turning\n',
'to Alice as it spoke.\n',
'\n',
"'As wet as ever,' said Alice in a melancholy tone: 'it doesn't seem to\n",
"dry me at all.'\n",
'\n',
"'In that case,' said the Dodo solemnly, rising to its feet, 'I move\n",
'that the meeting adjourn, for the immediate adoption of more energetic\n',
"remedies--'\n",
'\n',
"'Speak English!' said the Eaglet. 'I don't know the meaning of half\n",
"those long words, and, what's more, I don't believe you do either!' And\n",
'the Eaglet bent down its head to hide a smile: some of the other birds\n',
'tittered audibly.\n',
'\n',
"'What I was going to say,' said the Dodo in an offended tone, 'was, that\n",
"the best thing to get us dry would be a Caucus-race.'\n",
'\n',
"'What IS a Caucus-race?' said Alice; not that she wanted much to know,\n",
'but the Dodo had paused as if it thought that SOMEBODY ought to speak,\n',
'and no one else seemed inclined to say anything.\n',
'\n',
"'Why,' said the Dodo, 'the best way to explain it is to do it.' (And, as\n",
'you might like to try the thing yourself, some winter day, I will tell\n',
'you how the Dodo managed it.)\n',
'\n',
"First it marked out a race-course, in a sort of circle, ('the exact\n",
"shape doesn't matter,' it said,) and then all the party were placed\n",
"along the course, here and there. There was no 'One, two, three, and\n",
"away,' but they began running when they liked, and left off when they\n",
'liked, so that it was not easy to know when the race was over. However,\n',
'when they had been running half an hour or so, and were quite dry again,\n',
"the Dodo suddenly called out 'The race is over!' and they all crowded\n",
"round it, panting, and asking, 'But who has won?'\n",
'\n',
'This question the Dodo could not answer without a great deal of thought,\n',
'and it sat for a long time with one finger pressed upon its forehead\n',
'(the position in which you usually see Shakespeare, in the pictures\n',
'of him), while the rest waited in silence. At last the Dodo said,\n',
"'EVERYBODY has won, and all must have prizes.'\n",
'\n',
"'But who is to give the prizes?' quite a chorus of voices asked.\n",
'\n',
"'Why, SHE, of course,' said the Dodo, pointing to Alice with one finger;\n",
'and the whole party at once crowded round her, calling out in a confused\n',
"way, 'Prizes! Prizes!'\n",
'\n',
'Alice had no idea what to do, and in despair she put her hand in her\n',
'pocket, and pulled out a box of comfits, (luckily the salt water had\n',
'not got into it), and handed them round as prizes. There was exactly one\n',
'a-piece all round.\n',
'\n',
"'But she must have a prize herself, you know,' said the Mouse.\n",
'\n',
"'Of course,' the Dodo replied very gravely. 'What else have you got in\n",
"your pocket?' he went on, turning to Alice.\n",
'\n',
"'Only a thimble,' said Alice sadly.\n",
'\n',
"'Hand it over here,' said the Dodo.\n",
'\n',
'Then they all crowded round her once more, while the Dodo solemnly\n',
"presented the thimble, saying 'We beg your acceptance of this elegant\n",
"thimble'; and, when it had finished this short speech, they all cheered.\n",
'\n',
'Alice thought the whole thing very absurd, but they all looked so grave\n',
'that she did not dare to laugh; and, as she could not think of anything\n',
'to say, she simply bowed, and took the thimble, looking as solemn as she\n',
'could.\n',
'\n',
'The next thing was to eat the comfits: this caused some noise and\n',
'confusion, as the large birds complained that they could not taste\n',
'theirs, and the small ones choked and had to be patted on the back.\n',
'However, it was over at last, and they sat down again in a ring, and\n',
'begged the Mouse to tell them something more.\n',
'\n',
"'You promised to tell me your history, you know,' said Alice, 'and why\n",
"it is you hate--C and D,' she added in a whisper, half afraid that it\n",
'would be offended again.\n',
'\n',
"'Mine is a long and a sad tale!' said the Mouse, turning to Alice, and\n",
'sighing.\n',
'\n',
"'It IS a long tail, certainly,' said Alice, looking down with wonder at\n",
"the Mouse's tail; 'but why do you call it sad?' And she kept on puzzling\n",
'about it while the Mouse was speaking, so that her idea of the tale was\n',
'something like this:--\n',
'\n',
" 'Fury said to a\n",
' mouse, That he\n',
' met in the\n',
' house,\n',
' "Let us\n',
' both go to\n',
' law: I will\n',
' prosecute\n',
' YOU.--Come,\n',
" I'll take no\n",
' denial; We\n',
' must have a\n',
' trial: For\n',
' really this\n',
" morning I've\n",
' nothing\n',
' to do."\n',
' Said the\n',
' mouse to the\n',
' cur, "Such\n',
' a trial,\n',
' dear Sir,\n',
' With\n',
' no jury\n',
' or judge,\n',
' would be\n',
' wasting\n',
' our\n',
' breath."\n',
' "I\'ll be\n',
" judge, I'll\n",
' be jury,"\n',
' Said\n',
' cunning\n',
' old Fury:\n',
' "I\'ll\n',
' try the\n',
' whole\n',
' cause,\n',
' and\n',
' condemn\n',
' you\n',
' to\n',
' death."\'\n',
'\n',
'\n',
"'You are not attending!' said the Mouse to Alice severely. 'What are you\n",
"thinking of?'\n",
'\n',
"'I beg your pardon,' said Alice very humbly: 'you had got to the fifth\n",
"bend, I think?'\n",
'\n',
"'I had NOT!' cried the Mouse, sharply and very angrily.\n",
'\n',
"'A knot!' said Alice, always ready to make herself useful, and looking\n",
"anxiously about her. 'Oh, do let me help to undo it!'\n",
'\n',
"'I shall do nothing of the sort,' said the Mouse, getting up and walking\n",
"away. 'You insult me by talking such nonsense!'\n",
'\n',
"'I didn't mean it!' pleaded poor Alice. 'But you're so easily offended,\n",
"you know!'\n",
'\n',
'The Mouse only growled in reply.\n',
'\n',
"'Please come back and finish your story!' Alice called after it; and the\n",
"others all joined in chorus, 'Yes, please do!' but the Mouse only shook\n",
'its head impatiently, and walked a little quicker.\n',
'\n',
"'What a pity it wouldn't stay!' sighed the Lory, as soon as it was quite\n",
'out of sight; and an old Crab took the opportunity of saying to her\n',
"daughter 'Ah, my dear! Let this be a lesson to you never to lose\n",
"YOUR temper!' 'Hold your tongue, Ma!' said the young Crab, a little\n",
"snappishly. 'You're enough to try the patience of an oyster!'\n",
'\n',
"'I wish I had our Dinah here, I know I do!' said Alice aloud, addressing\n",
"nobody in particular. 'She'd soon fetch it back!'\n",
'\n',
"'And who is Dinah, if I might venture to ask the question?' said the\n",
'Lory.\n',
'\n',
'Alice replied eagerly, for she was always ready to talk about her pet:\n',
"'Dinah's our cat. And she's such a capital one for catching mice you\n",
"can't think! And oh, I wish you could see her after the birds! Why,\n",
"she'll eat a little bird as soon as look at it!'\n",
'\n',
'This speech caused a remarkable sensation among the party. Some of the\n',
'birds hurried off at once: one old Magpie began wrapping itself up very\n',
"carefully, remarking, 'I really must be getting home; the night-air\n",
"doesn't suit my throat!' and a Canary called out in a trembling voice to\n",
"its children, 'Come away, my dears! It's high time you were all in bed!'\n",
'On various pretexts they all moved off, and Alice was soon left alone.\n',
'\n',
"'I wish I hadn't mentioned Dinah!' she said to herself in a melancholy\n",
"tone. 'Nobody seems to like her, down here, and I'm sure she's the best\n",
'cat in the world! Oh, my dear Dinah! I wonder if I shall ever see you\n',
"any more!' And here poor Alice began to cry again, for she felt very\n",
'lonely and low-spirited. In a little while, however, she again heard\n',
'a little pattering of footsteps in the distance, and she looked up\n',
'eagerly, half hoping that the Mouse had changed his mind, and was coming\n',
'back to finish his story.\n',
'\n',
'\n',
'\n',
'\n',
'CHAPTER IV. The Rabbit Sends in a Little Bill\n',
'\n',
'It was the White Rabbit, trotting slowly back again, and looking\n',
'anxiously about as it went, as if it had lost something; and she heard\n',
"it muttering to itself 'The Duchess! The Duchess! Oh my dear paws! Oh\n",
"my fur and whiskers! She'll get me executed, as sure as ferrets are\n",
"ferrets! Where CAN I have dropped them, I wonder?' Alice guessed in a\n",
'moment that it was looking for the fan and the pair of white kid gloves,\n',
'and she very good-naturedly began hunting about for them, but they were\n',
'nowhere to be seen--everything seemed to have changed since her swim in\n',
'the pool, and the great hall, with the glass table and the little door,\n',
'had vanished completely.\n',
'\n',
'Very soon the Rabbit noticed Alice, as she went hunting about, and\n',
"called out to her in an angry tone, 'Why, Mary Ann, what ARE you doing\n",
'out here? Run home this moment, and fetch me a pair of gloves and a fan!\n',
"Quick, now!' And Alice was so much frightened that she ran off at once\n",
'in the direction it pointed to, without trying to explain the mistake it\n',
'had made.\n',
'\n',
"'He took me for his housemaid,' she said to herself as she ran. 'How\n",
"surprised he'll be when he finds out who I am! But I'd better take him\n",
"his fan and gloves--that is, if I can find them.' As she said this, she\n",
'came upon a neat little house, on the door of which was a bright brass\n',
"plate with the name 'W. RABBIT' engraved upon it. She went in without\n",
'knocking, and hurried upstairs, in great fear lest she should meet the\n',
'real Mary Ann, and be turned out of the house before she had found the\n',
'fan and gloves.\n',
'\n',
"'How queer it seems,' Alice said to herself, 'to be going messages for\n",
"a rabbit! I suppose Dinah'll be sending me on messages next!' And she\n",
'began fancying the sort of thing that would happen: \'"Miss Alice! Come\n',
'here directly, and get ready for your walk!" "Coming in a minute,\n',
'nurse! But I\'ve got to see that the mouse doesn\'t get out." Only I don\'t\n',
"think,' Alice went on, 'that they'd let Dinah stop in the house if it\n",
"began ordering people about like that!'\n",
'\n',
'By this time she had found her way into a tidy little room with a table\n',
'in the window, and on it (as she had hoped) a fan and two or three pairs\n',
'of tiny white kid gloves: she took up the fan and a pair of the gloves,\n',
'and was just going to leave the room, when her eye fell upon a little\n',
'bottle that stood near the looking-glass. There was no label this time\n',
"with the words 'DRINK ME,' but nevertheless she uncorked it and put it\n",
"to her lips. 'I know SOMETHING interesting is sure to happen,' she said\n",
"to herself, 'whenever I eat or drink anything; so I'll just see what\n",
"this bottle does. I do hope it'll make me grow large again, for really\n",
"I'm quite tired of being such a tiny little thing!'\n",
'\n',
'It did so indeed, and much sooner than she had expected: before she had\n',
'drunk half the bottle, she found her head pressing against the ceiling,\n',
'and had to stoop to save her neck from being broken. She hastily put\n',
"down the bottle, saying to herself 'That's quite enough--I hope I shan't\n",
"grow any more--As it is, I can't get out at the door--I do wish I hadn't\n",
"drunk quite so much!'\n",
'\n',
'Alas! it was too late to wish that! She went on growing, and growing,\n',
'and very soon had to kneel down on the floor: in another minute there\n',
'was not even room for this, and she tried the effect of lying down with\n',
'one elbow against the door, and the other arm curled round her head.\n',
'Still she went on growing, and, as a last resource, she put one arm out\n',
"of the window, and one foot up the chimney, and said to herself 'Now I\n",
"can do no more, whatever happens. What WILL become of me?'\n",
'\n',
'Luckily for Alice, the little magic bottle had now had its full effect,\n',
'and she grew no larger: still it was very uncomfortable, and, as there\n',
'seemed to be no sort of chance of her ever getting out of the room\n',
'again, no wonder she felt unhappy.\n',
'\n',
"'It was much pleasanter at home,' thought poor Alice, 'when one wasn't\n",
'always growing larger and smaller, and being ordered about by mice and\n',
"rabbits. I almost wish I hadn't gone down that rabbit-hole--and yet--and\n",
"yet--it's rather curious, you know, this sort of life! I do wonder what\n",
'CAN have happened to me! When I used to read fairy-tales, I fancied that\n',
'kind of thing never happened, and now here I am in the middle of one!\n',
'There ought to be a book written about me, that there ought! And when I\n',
"grow up, I'll write one--but I'm grown up now,' she added in a sorrowful\n",
"tone; 'at least there's no room to grow up any more HERE.'\n",
'\n',
"'But then,' thought Alice, 'shall I NEVER get any older than I am\n",
"now? That'll be a comfort, one way--never to be an old woman--but\n",
"then--always to have lessons to learn! Oh, I shouldn't like THAT!'\n",
'\n',
"'Oh, you foolish Alice!' she answered herself. 'How can you learn\n",
"lessons in here? Why, there's hardly room for YOU, and no room at all\n",
"for any lesson-books!'\n",
'\n',
'And so she went on, taking first one side and then the other, and making\n',
'quite a conversation of it altogether; but after a few minutes she heard\n',
'a voice outside, and stopped to listen.\n',
'\n',
"'Mary Ann! Mary Ann!' said the voice. 'Fetch me my gloves this moment!'\n",
'Then came a little pattering of feet on the stairs. Alice knew it was\n',
'the Rabbit coming to look for her, and she trembled till she shook the\n',
'house, quite forgetting that she was now about a thousand times as large\n',
'as the Rabbit, and had no reason to be afraid of it.\n',
'\n',
'Presently the Rabbit came up to the door, and tried to open it; but, as\n',
"the door opened inwards, and Alice's elbow was pressed hard against it,\n",
"that attempt proved a failure. Alice heard it say to itself 'Then I'll\n",
"go round and get in at the window.'\n",
'\n',
"'THAT you won't' thought Alice, and, after waiting till she fancied\n",
'she heard the Rabbit just under the window, she suddenly spread out her\n',
'hand, and made a snatch in the air. She did not get hold of anything,\n',
'but she heard a little shriek and a fall, and a crash of broken glass,\n',
'from which she concluded that it was just possible it had fallen into a\n',
'cucumber-frame, or something of the sort.\n',
'\n',
"Next came an angry voice--the Rabbit's--'Pat! Pat! Where are you?' And\n",
"then a voice she had never heard before, 'Sure then I'm here! Digging\n",
"for apples, yer honour!'\n",
'\n',
"'Digging for apples, indeed!' said the Rabbit angrily. 'Here! Come and\n",
"help me out of THIS!' (Sounds of more broken glass.)\n",
'\n',
"'Now tell me, Pat, what's that in the window?'\n",
'\n',
"'Sure, it's an arm, yer honour!' (He pronounced it 'arrum.')\n",
'\n',
"'An arm, you goose! Who ever saw one that size? Why, it fills the whole\n",
"window!'\n",
'\n',
"'Sure, it does, yer honour: but it's an arm for all that.'\n",
'\n',
"'Well, it's got no business there, at any rate: go and take it away!'\n",
'\n',
'There was a long silence after this, and Alice could only hear whispers\n',
"now and then; such as, 'Sure, I don't like it, yer honour, at all, at\n",
"all!' 'Do as I tell you, you coward!' and at last she spread out her\n",
'hand again, and made another snatch in the air. This time there were\n',
"TWO little shrieks, and more sounds of broken glass. 'What a number of\n",
"cucumber-frames there must be!' thought Alice. 'I wonder what they'll do\n",
"next! As for pulling me out of the window, I only wish they COULD! I'm\n",
"sure I don't want to stay in here any longer!'\n",
'\n',
'She waited for some time without hearing anything more: at last came a\n',
'rumbling of little cartwheels, and the sound of a good many voices\n',
"all talking together: she made out the words: 'Where's the other\n",
"ladder?--Why, I hadn't to bring but one; Bill's got the other--Bill!\n",
"fetch it here, lad!--Here, put 'em up at this corner--No, tie 'em\n",
"together first--they don't reach half high enough yet--Oh! they'll\n",
"do well enough; don't be particular--Here, Bill! catch hold of this\n",
"rope--Will the roof bear?--Mind that loose slate--Oh, it's coming\n",
"down! Heads below!' (a loud crash)--'Now, who did that?--It was Bill, I\n",
"fancy--Who's to go down the chimney?--Nay, I shan't! YOU do it!--That I\n",
"won't, then!--Bill's to go down--Here, Bill! the master says you're to\n",
"go down the chimney!'\n",
'\n',
"'Oh! So Bill's got to come down the chimney, has he?' said Alice to\n",
"herself. 'Shy, they seem to put everything upon Bill! I wouldn't be in\n",
"Bill's place for a good deal: this fireplace is narrow, to be sure; but\n",
"I THINK I can kick a little!'\n",
'\n',
'She drew her foot as far down the chimney as she could, and waited\n',
"till she heard a little animal (she couldn't guess of what sort it was)\n",
'scratching and scrambling about in the chimney close above her: then,\n',
"saying to herself 'This is Bill,' she gave one sharp kick, and waited to\n",
'see what would happen next.\n',
'\n',
"The first thing she heard was a general chorus of 'There goes Bill!'\n",
"then the Rabbit's voice along--'Catch him, you by the hedge!' then\n",
"silence, and then another confusion of voices--'Hold up his head--Brandy\n",
"now--Don't choke him--How was it, old fellow? What happened to you? Tell\n",
"us all about it!'\n",
'\n',
"Last came a little feeble, squeaking voice, ('That's Bill,' thought\n",
"Alice,) 'Well, I hardly know--No more, thank ye; I'm better now--but I'm\n",
'a deal too flustered to tell you--all I know is, something comes at me\n',
"like a Jack-in-the-box, and up I goes like a sky-rocket!'\n",
'\n',
"'So you did, old fellow!' said the others.\n",
'\n',
"'We must burn the house down!' said the Rabbit's voice; and Alice called\n",
"out as loud as she could, 'If you do. I'll set Dinah at you!'\n",
'\n',
"There was a dead silence instantly, and Alice thought to herself, 'I\n",
"wonder what they WILL do next! If they had any sense, they'd take the\n",
"roof off.' After a minute or two, they began moving about again, and\n",
"Alice heard the Rabbit say, 'A barrowful will do, to begin with.'\n",
'\n',
"'A barrowful of WHAT?' thought Alice; but she had not long to doubt,\n",
'for the next moment a shower of little pebbles came rattling in at the\n',
"window, and some of them hit her in the face. 'I'll put a stop to this,'\n",
"she said to herself, and shouted out, 'You'd better not do that again!'\n",
'which produced another dead silence.\n',
'\n',
'Alice noticed with some surprise that the pebbles were all turning into\n',
'little cakes as they lay on the floor, and a bright idea came into her\n',
"head. 'If I eat one of these cakes,' she thought, 'it's sure to make\n",
"SOME change in my size; and as it can't possibly make me larger, it must\n",
"make me smaller, I suppose.'\n",
'\n',
'So she swallowed one of the cakes, and was delighted to find that she\n',
'began shrinking directly. As soon as she was small enough to get through\n',
'the door, she ran out of the house, and found quite a crowd of little\n',
'animals and birds waiting outside. The poor little Lizard, Bill, was\n',
'in the middle, being held up by two guinea-pigs, who were giving it\n',
'something out of a bottle. They all made a rush at Alice the moment she\n',
'appeared; but she ran off as hard as she could, and soon found herself\n',
'safe in a thick wood.\n',
'\n',
"'The first thing I've got to do,' said Alice to herself, as she wandered\n",
"about in the wood, 'is to grow to my right size again; and the second\n",
'thing is to find my way into that lovely garden. I think that will be\n',
"the best plan.'\n",
'\n',
'It sounded an excellent plan, no doubt, and very neatly and simply\n',
'arranged; the only difficulty was, that she had not the smallest idea\n',
'how to set about it; and while she was peering about anxiously among\n',
'the trees, a little sharp bark just over her head made her look up in a\n',
'great hurry.\n',
'\n',
'An enormous puppy was looking down at her with large round eyes, and\n',
"feebly stretching out one paw, trying to touch her. 'Poor little thing!'\n",
'said Alice, in a coaxing tone, and she tried hard to whistle to it; but\n',
'she was terribly frightened all the time at the thought that it might be\n',
'hungry, in which case it would be very likely to eat her up in spite of\n',
'all her coaxing.\n',
'\n',
'Hardly knowing what she did, she picked up a little bit of stick, and\n',
'held it out to the puppy; whereupon the puppy jumped into the air off\n',
'all its feet at once, with a yelp of delight, and rushed at the stick,\n',
'and made believe to worry it; then Alice dodged behind a great thistle,\n',
'to keep herself from being run over; and the moment she appeared on the\n',
'other side, the puppy made another rush at the stick, and tumbled head\n',
'over heels in its hurry to get hold of it; then Alice, thinking it was\n',
'very like having a game of play with a cart-horse, and expecting every\n',
'moment to be trampled under its feet, ran round the thistle again; then\n',
'the puppy began a series of short charges at the stick, running a very\n',
'little way forwards each time and a long way back, and barking hoarsely\n',
'all the while, till at last it sat down a good way off, panting, with\n',
'its tongue hanging out of its mouth, and its great eyes half shut.\n',
'\n',
'This seemed to Alice a good opportunity for making her escape; so she\n',
'set off at once, and ran till she was quite tired and out of breath, and\n',
"till the puppy's bark sounded quite faint in the distance.\n",
'\n',
"'And yet what a dear little puppy it was!' said Alice, as she leant\n",
'against a buttercup to rest herself, and fanned herself with one of the\n',
"leaves: 'I should have liked teaching it tricks very much, if--if I'd\n",
"only been the right size to do it! Oh dear! I'd nearly forgotten that\n",
"I've got to grow up again! Let me see--how IS it to be managed? I\n",
'suppose I ought to eat or drink something or other; but the great\n',
"question is, what?'\n",
'\n',
'The great question certainly was, what? Alice looked all round her at\n',
'the flowers and the blades of grass, but she did not see anything that\n',
'looked like the right thing to eat or drink under the circumstances.\n',
'There was a large mushroom growing near her, about the same height as\n',
'herself; and when she had looked under it, and on both sides of it, and\n',
'behind it, it occurred to her that she might as well look and see what\n',
'was on the top of it.\n',
'\n',
'She stretched herself up on tiptoe, and peeped over the edge of the\n',
'mushroom, and her eyes immediately met those of a large caterpillar,\n',
'that was sitting on the top with its arms folded, quietly smoking a long\n',
'hookah, and taking not the smallest notice of her or of anything else.\n',
'\n',
'\n',
'\n',
'\n',
'CHAPTER V. Advice from a Caterpillar\n',
'\n',
'The Caterpillar and Alice looked at each other for some time in silence:\n',
'at last the Caterpillar took the hookah out of its mouth, and addressed\n',
'her in a languid, sleepy voice.\n',
'\n',
"'Who are YOU?' said the Caterpillar.\n",
'\n',
'This was not an encouraging opening for a conversation. Alice replied,\n',
"rather shyly, 'I--I hardly know, sir, just at present--at least I know\n",
'who I WAS when I got up this morning, but I think I must have been\n',
"changed several times since then.'\n",
'\n',
"'What do you mean by that?' said the Caterpillar sternly. 'Explain\n",
"yourself!'\n",
'\n',
"'I can't explain MYSELF, I'm afraid, sir' said Alice, 'because I'm not\n",
"myself, you see.'\n",
'\n',
"'I don't see,' said the Caterpillar.\n",
'\n',
"'I'm afraid I can't put it more clearly,' Alice replied very politely,\n",
"'for I can't understand it myself to begin with; and being so many\n",
"different sizes in a day is very confusing.'\n",
'\n',
"'It isn't,' said the Caterpillar.\n",
'\n',
"'Well, perhaps you haven't found it so yet,' said Alice; 'but when you\n",
'have to turn into a chrysalis--you will some day, you know--and then\n',
"after that into a butterfly, I should think you'll feel it a little\n",
"queer, won't you?'\n",
'\n',
"'Not a bit,' said the Caterpillar.\n",
'\n',
"'Well, perhaps your feelings may be different,' said Alice; 'all I know\n",
"is, it would feel very queer to ME.'\n",
'\n',
"'You!' said the Caterpillar contemptuously. 'Who are YOU?'\n",
'\n',
'Which brought them back again to the beginning of the conversation.\n',
"Alice felt a little irritated at the Caterpillar's making such VERY\n",
"short remarks, and she drew herself up and said, very gravely, 'I think,\n",
"you ought to tell me who YOU are, first.'\n",
'\n',
"'Why?' said the Caterpillar.\n",
'\n',
'Here was another puzzling question; and as Alice could not think of any\n',
'good reason, and as the Caterpillar seemed to be in a VERY unpleasant\n',
'state of mind, she turned away.\n',
'\n',
"'Come back!' the Caterpillar called after her. 'I've something important\n",
"to say!'\n",
'\n',
'This sounded promising, certainly: Alice turned and came back again.\n',
'\n',
"'Keep your temper,' said the Caterpillar.\n",
'\n',
"'Is that all?' said Alice, swallowing down her anger as well as she\n",
'could.\n',
'\n',
"'No,' said the Caterpillar.\n",
'\n',
'Alice thought she might as well wait, as she had nothing else to do, and\n',
'perhaps after all it might tell her something worth hearing. For some\n',
'minutes it puffed away without speaking, but at last it unfolded its\n',
"arms, took the hookah out of its mouth again, and said, 'So you think\n",
"you're changed, do you?'\n",
'\n',
"'I'm afraid I am, sir,' said Alice; 'I can't remember things as I\n",
"used--and I don't keep the same size for ten minutes together!'\n",
'\n',
"'Can't remember WHAT things?' said the Caterpillar.\n",
'\n',
'\'Well, I\'ve tried to say "HOW DOTH THE LITTLE BUSY BEE," but it all came\n',
"different!' Alice replied in a very melancholy voice.\n",
...]
tokenizer = Tokenizer(num_words=3000,oov_token='unknow')
tokenizer.fit_on_texts(doc)
doc1 = tokenizer.texts_to_sequences(doc)
doc1
[[51, 1297, 273, 402, 11, 622, 60, 1298, 1299],
[],
[24, 545, 32, 25, 2, 152, 7, 702, 1002, 20, 48, 814, 4, 19],
[480, 48, 1300, 1301, 12, 176, 340, 9, 314, 9, 170, 28],
[1302, 152, 9, 203, 2, 204, 7, 2, 51, 49, 258, 1003],
[19, 24, 545, 28, 815, 20, 703, 49, 341],
[],
[],
[1821, 273, 402, 11, 622],
[13, 14, 274, 5, 116, 30, 546, 7, 403, 60, 18, 481, 21, 2],
[1004, 4, 7, 404, 155, 5, 45, 149, 28, 704, 8, 23, 1005, 69, 2],
[370, 18, 481, 14, 816, 31, 9, 23, 48, 817, 28, 1303, 11],
[9, 81, 38, 32, 2, 152, 7, 6, 370, 3, 63, 13, 1822, 817, 28],
[1303, 3],
[],
[29, 8, 14, 1006, 11, 18, 405, 371, 17, 122, 17, 8, 58, 25, 2],
[547, 162, 156, 18, 482, 30, 705, 4, 1007, 372, 2, 1304],
[7, 483, 6, 1823, 1824, 59, 26, 818, 2, 623, 7, 205, 39, 4],
[1305, 2, 1825, 61, 315, 6, 157, 112, 19, 1826, 163, 259],
[316, 60, 18],
[],
[64, 14, 155, 29, 30, 1306, 11, 16, 1307, 75, 13, 91, 9, 29],
[30, 94, 36, 7, 2, 77, 5, 294, 2, 112, 95, 5, 295, 197, 171],
[206, 171, 15, 189, 26, 624, 3, 61, 8, 63, 9, 123, 1308, 9],
[1309, 5, 18, 16, 8, 296, 5, 56, 1827, 20, 24, 31, 20, 2, 65],
[9, 22, 177, 84, 819, 31, 61, 2, 112, 1828, 194, 6, 484],
[36, 7, 73, 1310, 548, 4, 113, 20, 9, 4, 57, 373, 21],
[13, 1311, 5, 18, 231, 25, 9, 1829, 706, 18, 371, 16, 8, 23],
[114, 124, 275, 6, 112, 19, 406, 6, 1310, 548, 28, 6, 484],
[5, 222, 36, 7, 9, 4, 1830, 19, 707, 8, 259, 706, 2, 1831],
[120, 9, 4, 1832, 14, 103, 11, 65, 5, 66, 9, 1833, 40, 6, 141],
[112, 820, 203, 2, 1312],
[],
[11, 207, 164, 40, 53, 13, 120, 9, 114, 149, 1006, 92],
[11, 2, 549, 8, 14, 5, 116, 36, 54],
[],
[2, 112, 820, 53, 1313, 21, 50, 6, 1834, 25, 96, 77, 4, 57],
[1314, 315, 40, 29, 315, 16, 13, 23, 27, 6, 164, 5, 91],
[41, 1835, 55, 124, 8, 142, 55, 1315, 40, 6, 30, 550],
[122],
[],
[406, 2, 122, 14, 30, 550, 28, 8, 625, 30, 485, 25, 8, 23],
[1316, 7, 65, 17, 8, 53, 40, 5, 172, 41, 18, 4, 5, 238, 38, 14],
[178, 5, 486, 158, 99, 8, 232, 5, 172, 40, 4, 165, 36, 38],
[8, 14, 443, 5, 31, 9, 14, 185, 1008, 5, 66, 211, 57, 8],
[113, 20, 2, 821, 7, 2, 122, 4, 487, 16, 35, 52, 1009, 19],
[1317, 4, 370, 1318, 106, 4, 64, 8, 297, 1836, 4, 817],
[1837, 173, 1838, 8, 194, 40, 6, 1319, 100, 42, 7, 2, 1318, 17],
[8, 708, 9, 14, 1839, 1840, 1841, 31, 5, 18, 129],
[1842, 9, 14, 1843, 8, 75, 27, 50, 5, 1844, 2, 1319, 25, 822],
[7, 1845, 626, 29, 823, 5, 153, 9, 69, 42, 7, 2, 1317, 17],
[8, 625, 1010, 9],
[],
[198, 3, 63, 13, 5, 55, 1320, 110, 6, 551, 17, 24, 15, 189],
[91, 155, 7, 1321, 40, 1011, 92, 1846, 824, 22, 91, 70, 20],
[709, 239, 15, 342, 95, 211, 41, 9, 212, 43, 15, 625, 72, 2, 488],
[7, 2, 240, 3, 97, 14, 30, 710, 825],
[],
[40, 40, 40, 59, 2, 551, 114, 150, 5, 76, 223, 34, 238, 92],
[298, 1012, 224, 826, 60, 24, 65, 3, 8, 10, 711, 34, 89, 26, 205],
[1013, 276, 2, 1847, 7, 2, 827, 299, 70, 66, 16, 59, 26, 489],
[1322, 1012, 40, 15, 91, 3, 25, 12, 66, 13, 23, 1323, 712],
[143, 7, 24, 225, 11, 18, 407, 11, 2, 1848, 4, 374, 24],
[14, 27, 6, 30, 179, 444, 25, 1324, 72, 18, 1014, 17, 64],
[14, 48, 42, 5, 552, 5, 18, 317, 9, 14, 179, 1849, 5, 95, 9, 123],
[3, 1850, 241, 41, 2, 137, 490, 31, 57, 15, 238, 38, 1325],
[28, 1326, 224, 115, 5, 3, 13, 23, 48, 277, 38, 1325, 14, 28],
[1326, 406, 31, 63, 35, 52, 627, 1015, 213, 5, 95],
[],
[1327, 8, 78, 54, 34, 238, 43, 15, 189, 551, 137, 260, 2],
[827, 92, 1016, 553, 491, 5, 150, 36, 343, 2, 278, 16, 713, 19],
[98, 408, 1851, 2, 1852, 15, 91, 3, 8, 14, 190, 375],
[64, 14, 48, 42, 1017, 24, 65, 17, 9, 300, 828, 20, 22, 2],
[137, 376, 3, 31, 15, 189, 56, 5, 377, 46, 38, 2, 378, 7, 2, 1018],
[32, 12, 47, 242, 1853, 32, 24, 628, 1854, 28, 1855, 3, 4],
[8, 232, 5, 1856, 17, 8, 249, 554, 1857, 17, 250, 1315],
[260, 2, 279, 45, 12, 91, 12, 58, 555, 9, 81, 38, 76],
[1858, 33, 829, 1019, 91, 70, 25, 714, 48, 553, 114, 45, 5],
[377, 301, 15, 189, 66, 9, 445, 39, 1013, 3],
[],
[40, 40, 40, 64, 14, 155, 379, 5, 45, 29, 13, 191, 78],
[261, 54, 1859, 830, 70, 30, 94, 5, 715, 15, 166, 91, 3],
[380, 14, 2, 138, 34, 831, 824, 302, 18, 1860, 7, 1328, 20],
[233, 65, 380, 82, 171, 15, 208, 12, 52, 40, 106, 19, 70, 64, 71, 48],
[832, 11, 2, 279, 130, 344, 31, 12, 174, 1020, 6, 1021, 4, 241, 30],
[50, 6, 119, 12, 47, 31, 45, 318, 251, 833, 15, 238, 3, 4, 106, 13],
[78, 5, 116, 190, 705, 4, 53, 21, 280, 5, 55, 11, 6, 1861],
[225, 7, 77, 492, 318, 251, 833, 45, 318, 251, 833, 3, 4, 716, 492],
[833, 251, 318, 3, 25, 12, 66, 17, 8, 446, 447, 406, 252],
[9, 300, 94, 448, 97, 77, 8, 153, 9, 8, 199, 16, 8, 14, 1862],
[72, 4, 23, 103, 556, 5, 557, 16, 8, 14, 717, 226, 11, 226, 19],
[380, 4, 280, 5, 18, 30, 1329, 409, 380, 167, 70, 2, 1863],
[75, 12, 214, 251, 6, 1021, 3, 61, 315, 1330, 1330, 40, 8, 125, 173],
[6, 1864, 7, 1865, 4, 493, 629, 4, 2, 551, 14, 123],
[],
[13, 14, 27, 6, 262, 1022, 4, 8, 630, 39, 21, 5, 18, 231, 11, 6, 164],
[8, 113, 39, 31, 9, 14, 22, 1008, 1866, 124, 18, 14, 207],
[144, 834, 4, 2, 157, 112, 14, 317, 11, 410, 1867, 40, 9],
[64, 14, 27, 6, 164, 5, 26, 1023, 170, 53, 13, 50, 2, 1331, 4],
[14, 103, 11, 65, 5, 294, 9, 95, 17, 9, 263, 6, 835, 197, 82, 718],
[4, 1024, 92, 624, 145, 205, 3, 8, 14, 316, 319, 9, 61, 8],
[263, 2, 835, 31, 2, 112, 14, 48, 1025, 5, 26, 275, 8, 142],
[55, 11, 6, 144, 281, 449, 97, 14, 1868, 39, 60, 6, 1332, 7, 1869, 1026],
[100, 2, 631],
[],
[64, 52, 1333, 22, 121, 2, 449, 31, 35, 52, 22, 1870, 4, 61],
[13, 23, 134, 22, 2, 77, 40, 42, 253, 4, 39, 2, 90, 303, 345],
[159, 8, 411, 719, 40, 2, 494, 558, 92, 8, 14, 214, 5],
[116, 36, 54],
[],
[315, 8, 125, 173, 6, 33, 180, 1334, 243, 22, 156, 7, 1871],
[412, 64, 14, 155, 21, 9, 559, 6, 836, 560, 450, 4, 273],
[99, 63, 14, 16, 9, 174, 1872, 5, 42, 7, 2, 1333, 7, 2, 449],
[31, 837, 406, 2, 1335, 52, 185, 141, 28, 2, 450, 14, 185, 346],
[31, 20, 62, 451, 9, 59, 27, 561, 62, 7, 46, 227, 21, 2, 632],
[65, 121, 8, 125, 173, 6, 281, 1873, 8, 23, 27, 487, 124, 4],
[319, 9, 14, 6, 33, 159, 41, 1874, 633, 264, 8, 232, 2],
[33, 560, 450, 11, 2, 1875, 4, 5, 18, 129, 1027, 9, 1876],
[],
[13, 413, 2, 159, 4, 142, 16, 9, 838, 69, 6, 346, 834, 27],
[94, 562, 192, 6, 1877, 820, 8, 1878, 40, 4, 113, 634, 2, 834],
[69, 2, 1879, 265, 12, 214, 297, 92, 8, 1336, 5, 116, 36, 7],
[16, 1008, 449, 4, 1880, 41, 343, 381, 1337, 7, 495, 1338, 4],
[381, 1339, 1340, 31, 8, 58, 27, 212, 116, 18, 104, 260, 2],
[1881, 81, 212, 43, 82, 104, 59, 107, 260, 3, 63, 186, 13, 160],
[59, 26, 7, 30, 33, 152, 146, 82, 839, 206, 92, 15, 208, 15, 58],
[720, 39, 50, 6, 1028, 15, 91, 15, 58, 43, 15, 108, 282, 92, 5, 347, 3],
[25, 12, 66, 29, 298, 36, 7, 2, 77, 143, 23, 563, 1882],
[16, 13, 23, 556, 5, 91, 16, 30, 414, 143, 266, 52, 415],
[1029],
[],
[64, 177, 5, 26, 48, 152, 11, 452, 60, 2, 33, 159, 29, 8, 53],
[135, 5, 2, 243, 200, 1030, 8, 174, 215, 207, 450, 21, 9, 28, 20],
[62, 451, 6, 370, 7, 721, 25, 1341, 278, 39, 50, 1883, 24],
[65, 8, 142, 6, 33, 416, 21, 9, 840, 320, 14, 27, 106],
[124, 3, 10, 13, 4, 121, 2, 564, 7, 2, 416, 14, 6, 722],
[1342, 19, 2, 213, 1031, 1343, 1344, 1032, 21, 9, 11, 141],
[1884],
[],
[9, 14, 22, 30, 122, 5, 95, 1031, 70, 3, 31, 2, 1345, 33, 13, 14],
[27, 178, 5, 45, 16, 11, 6, 382, 321, 187, 172, 99, 3, 8, 10, 81],
[66, 372, 145, 496, 1885, 28, 1886, 25, 8, 23, 322, 712, 627],
[33, 1887, 41, 417, 79, 23, 115, 1888, 4, 1889, 39, 60, 1346],
[1347, 4, 90, 1348, 143, 22, 323, 35, 59, 27, 302],
[2, 723, 721, 98, 1349, 23, 841, 46, 110, 17, 16, 6, 1033, 547],
[1890, 126, 1350, 12, 43, 12, 565, 9, 185, 144, 4, 16, 43, 12, 724, 67],
[725, 30, 842, 19, 6, 1034, 9, 1351, 1891, 4, 8, 23, 114],
[635, 16, 43, 12, 843, 94, 100, 6, 416, 496, 1352, 3, 9, 32],
[480, 726, 5, 1892, 19, 12, 1353, 28, 1035],
[],
[227, 24, 416, 14, 27, 496, 1352, 3, 29, 13, 844, 5, 1354],
[9, 4, 1036, 9, 30, 627, 9, 23, 11, 497, 6, 225, 7, 1355, 1893],
[7, 1894, 1895, 1896, 1897, 1898, 1899, 1900, 1901, 4, 547],
[1902, 1903, 8, 30, 191, 348, 9, 72],
[],
[],
[],
[],
[],
[],
[],
[139, 6, 234, 566, 3, 10, 13, 34, 89, 26, 1341, 39, 50, 6],
[1028, 3],
[],
[4, 29, 9, 14, 266, 8, 14, 101, 108, 727, 633, 264, 4, 18, 283],
[1356, 39, 20, 2, 63, 16, 8, 14, 101, 2, 137, 324, 25, 178],
[260, 2, 33, 159, 69, 16, 1357, 265, 99, 227, 8],
[383, 25, 6, 414, 384, 5, 66, 43, 8, 14, 178, 5, 1904, 62, 845],
[8, 199, 6, 33, 728, 41, 24, 567, 9, 174, 223, 12, 47, 3, 10],
[13, 5, 55, 498, 82, 178, 36, 729, 50, 6, 1037, 15, 238],
[38, 15, 166, 26, 50, 57, 3, 4, 8, 232, 5, 554, 38, 2, 1905, 7, 6],
[1037, 32, 50, 120, 2, 1037, 32, 1906, 36, 25, 8, 58, 27, 302],
[214, 404, 275, 110, 6, 105],
[],
[120, 6, 188, 1036, 16, 155, 102, 563, 8, 1038, 21, 178],
[69, 2, 265, 20, 149, 31, 837, 25, 186, 13, 61, 8, 115, 5, 2],
[159, 8, 142, 8, 23, 635, 2, 33, 560, 450, 4, 61, 8],
[53, 135, 5, 2, 243, 25, 9, 8, 142, 8, 58, 27, 1039, 846],
[9, 8, 58, 66, 9, 84, 1907, 260, 2, 412, 4, 8, 232, 18],
[349, 5, 1908, 39, 42, 7, 2, 1040, 7, 2, 243, 31, 9, 14, 185, 1909],
[4, 61, 8, 23, 546, 55, 36, 19, 303, 2, 186, 33, 105],
[254, 40, 4, 228],
[],
[284, 255, 48, 152, 11, 1358, 50, 16, 3, 10, 13, 5, 55],
[190, 847, 34, 1910, 12, 5, 568, 72, 24, 216, 3, 8, 569],
[285, 55, 30, 179, 1359, 374, 8, 30, 1911, 499, 9],
[4, 716, 8, 1912, 55, 29, 848, 17, 5, 1360, 385, 69],
[18, 163, 4, 149, 8, 730, 303, 5, 418, 18, 405, 718, 25, 404],
[1913, 55, 11, 6, 350, 7, 453, 8, 14, 1361, 419, 55],
[25, 24, 234, 386, 14, 30, 849, 7, 1914, 5, 26, 136, 278],
[131, 145, 48, 152, 101, 3, 63, 186, 13, 731, 1915, 5, 26, 136, 278],
[239, 255, 351, 244, 7, 70, 304, 5, 165, 42, 1916, 500, 3],
[],
[191, 18, 570, 625, 21, 6, 33, 412, 418, 16, 14, 501, 203, 2, 243],
[8, 413, 9, 4, 142, 11, 9, 6, 30, 346, 1041, 21, 97, 2, 213],
[1917, 1343, 52, 1344, 496, 11, 1918, 198, 187, 251, 9, 3, 10],
[13, 81, 43, 9, 352, 70, 325, 562, 15, 117, 846, 2, 450, 4, 43, 9],
[352, 70, 325, 1042, 15, 117, 1919, 203, 2, 159, 29, 406, 77, 187],
[116, 69, 2, 265, 4, 15, 85, 850, 97, 732, 3],
[],
[8, 1920, 6, 33, 262, 4, 10, 305, 5, 55, 840, 77, 97],
[77, 3, 1043, 18, 226, 21, 2, 488, 7, 18, 104, 5, 482, 97, 77, 9, 14],
[387, 4, 8, 14, 84, 571, 5, 215, 16, 8, 1044, 2, 195],
[324, 5, 26, 229, 24, 569, 732, 61, 42, 1921, 1041, 31, 13],
[23, 115, 29, 94, 69, 2, 77, 7, 1045, 155, 31, 36, 7, 2, 77],
[143, 5, 486, 16, 9, 177, 84, 1046, 4, 1007, 25, 326, 5, 107, 21],
[11, 2, 1922, 77],
[],
[29, 8, 209, 5, 93, 4, 30, 191, 348, 72, 2, 1041],
[],
[],
[],
[],
[],
[],
[],
[],
[],
[],
[388, 1923, 2, 389, 7, 385],
[],
[1924, 4, 1925, 3, 228, 13, 8, 14, 29, 94, 571, 16],
[25, 2, 164, 8, 84, 1362, 92, 5, 327, 179, 636, 409, 130],
[1047, 36, 50, 2, 1926, 1028, 16, 214, 14, 179, 1363, 231, 3],
[25, 61, 8, 113, 40, 20, 18, 231, 35, 177, 5, 26, 480, 36, 7],
[410, 35, 52, 205, 29, 328, 72, 197, 82, 186, 33, 231, 15, 238],
[79, 126, 153, 21, 67, 572, 4, 1927, 25, 12, 101, 1048, 130, 229],
[15, 733, 26, 1928, 15, 189, 26, 6, 129, 353, 185, 328, 72, 5, 623],
[573, 41, 12, 12, 89, 555, 2, 349, 77, 12, 117, 31, 15, 89, 26],
[502, 5, 46, 3, 63, 13, 637, 301, 35, 201, 713, 2, 77, 15, 454],
[5, 107, 299, 70, 66, 187, 314, 46, 6, 628, 734, 7, 1049, 345, 1929, 3],
[],
[4, 8, 53, 21, 1930, 5, 55, 92, 8, 59, 555, 9, 420, 89],
[107, 60, 2, 1931, 3, 8, 63, 81, 92, 1016, 553, 491, 1050],
[1364, 5, 1932, 405, 231, 4, 92, 1933, 2, 1051, 126, 172],
[],
[273, 137, 421, 1934],
[1935],
[276, 2, 1936],
[19, 273, 1052],
[],
[206, 171, 38, 638, 130, 261, 3],
[],
[103, 57, 18, 104, 1365, 419, 2, 631, 7, 2, 449, 11, 497, 8, 14],
[101, 102, 192, 851, 231, 264, 4, 8, 20, 149, 194, 39, 2, 33, 560],
[450, 4, 373, 72, 5, 2, 265, 159],
[],
[186, 13, 9, 14, 17, 94, 17, 8, 58, 45, 501, 40, 21, 42, 253, 5],
[172, 260, 69, 2, 265, 19, 42, 570, 31, 5, 116, 260, 14, 102],
[1937, 192, 214, 8, 254, 40, 4, 78, 5, 1053, 54],
[],
[127, 296, 5, 26, 1366, 7, 422, 3, 10, 13, 390, 129, 829, 50],
[12, 3, 8, 174, 122, 95, 24, 731, 107, 21, 1358, 11, 24, 77, 639, 24],
[164, 15, 167, 12, 3, 31, 8, 53, 21, 22, 2, 195, 1938, 1939, 7],
[385, 852, 64, 14, 6, 141, 389, 22, 121, 18, 41, 489, 633],
[550, 4, 1367, 200, 40, 2, 449],
[],
[120, 6, 65, 8, 161, 6, 33, 1054, 7, 231, 11, 2, 490, 4],
[8, 267, 1940, 18, 163, 5, 66, 38, 14, 443, 9, 14, 2, 157],
[112, 1941, 1942, 1943, 19, 6, 734, 7, 157, 735, 391, 11],
[42, 226, 4, 6, 141, 423, 11, 2, 90, 37, 125, 1368, 634, 11, 6, 129],
[382, 1055, 5, 640, 17, 37, 125, 197, 2, 132, 2, 132],
[206, 201, 8, 26, 853, 43, 224, 329, 18, 452, 3, 13, 199, 29],
[1944, 16, 8, 14, 503, 5, 377, 392, 7, 62, 42, 29, 61, 2, 112],
[125, 276, 18, 8, 78, 11, 6, 281, 1056, 109, 217, 12, 242, 641, 3],
[2, 112, 1311, 854, 736, 2, 157, 735, 391, 4, 2, 423],
[4, 1945, 170, 69, 2, 1946, 17, 504, 17, 37, 58, 107],
[],
[13, 194, 39, 2, 423, 4, 391, 4, 17, 2, 449, 14, 30, 547, 8],
[329, 1947, 55, 22, 2, 65, 8, 53, 21, 261, 1948, 171, 92],
[354, 355, 32, 5, 162, 4, 1057, 143, 53, 21, 103, 17, 737],
[15, 238, 43, 224, 134, 505, 11, 2, 715, 299, 70, 91, 14, 15, 2],
[195, 61, 15, 115, 39, 24, 738, 15, 480, 91, 15, 117, 302, 566, 6],
[33, 424, 31, 43, 130, 27, 2, 195, 2, 158, 252, 32, 79],
[11, 2, 549, 286, 15, 1949, 241, 2, 129, 1950, 3, 4, 8, 78, 425],
[123, 22, 2, 417, 8, 282, 16, 52, 7, 2, 195, 855, 17, 55, 5],
[66, 43, 8, 58, 56, 134, 505, 25, 62, 7, 46],
[],
[230, 229, 130, 27, 1951, 3, 8, 10, 567, 18, 574, 575, 11, 110, 144],
[1369, 4, 455, 268, 107, 11, 1369, 20, 22, 4, 130, 229, 15, 181],
[26, 856, 25, 15, 47, 22, 1058, 7, 143, 4, 8, 206, 8, 1370, 110, 6],
[30, 33, 1059, 857, 8, 4, 130, 15, 4, 206, 171, 92, 858],
[9, 22, 32, 187, 356, 43, 15, 47, 22, 2, 143, 15, 269, 5, 47, 299, 70],
[66, 489, 642, 506, 32, 859, 4, 489, 642, 1371, 32, 1952, 4],
[489, 642, 739, 32, 206, 171, 15, 189, 114, 116, 5, 1372, 20, 16, 451],
[227, 2, 1953, 243, 268, 1954, 1060, 356, 1955],
[1956, 32, 2, 860, 7, 1373, 4, 1373, 32, 2, 860, 7, 1374, 4],
[1374, 48, 241, 22, 740, 130, 726, 15, 89, 56, 134, 505, 25],
[856, 187, 356, 4, 95, 92, 1061, 2, 33, 3, 4, 8, 1062, 18],
[357, 21, 18, 1375, 17, 43, 8, 52, 280, 407, 4, 78, 5, 643, 9],
[31, 18, 109, 741, 1063, 4, 742, 4, 2, 213, 75, 27, 150, 2],
[195, 17, 35, 269, 5, 45],
[],
[270, 1061, 2, 33, 1957],
[1958, 44, 1959, 456],
[4, 1960, 2, 1961, 7, 2, 1962],
[21, 345, 560, 1963],
[],
[270, 1964, 37, 743, 5, 644],
[92, 1376, 861, 44, 1377],
[4, 1965, 33, 1966, 11],
[19, 1064, 1378, 1379, 3],
[],
[230, 229, 381, 71, 27, 2, 137, 213, 3, 10, 186, 13, 4, 18, 163],
[1009, 19, 385, 54, 17, 8, 53, 21, 34, 89, 26, 856, 120, 22, 4],
[15, 189, 56, 5, 107, 4, 507, 11, 16, 1967, 33, 240, 4, 56, 158, 5],
[48, 1968, 5, 508, 19, 4, 206, 214, 29, 298, 407, 5, 509, 48, 224],
[156, 39, 82, 371, 41, 9, 43, 130, 856, 187, 744, 40, 106, 553, 26, 48],
[152, 98, 1065, 98, 408, 40, 4, 280, 150, 39, 54, 171, 15],
[189, 108, 172, 39, 4, 95, 79, 286, 15, 57, 167, 70, 16, 99, 4, 57],
[43, 15, 50, 235, 16, 500, 187, 150, 39, 43, 27, 187, 744, 40, 106],
[236, 130, 626, 379, 31, 206, 171, 3, 228, 13, 19, 6, 745, 1969],
[7, 385, 34, 45, 208, 35, 59, 153, 98, 408, 40, 15, 286, 29, 30, 546],
[7, 235, 22, 746, 106, 3],
[],
[17, 8, 10, 24, 8, 113, 40, 20, 18, 357, 4, 14, 571, 5, 66],
[16, 8, 23, 153, 21, 42, 7, 2, 862, 33, 157, 735, 391, 188],
[8, 14, 261, 270, 117, 15, 56, 287, 16, 3, 8, 63, 34, 89],
[26, 387, 346, 54, 3, 8, 115, 39, 4, 53, 5, 2, 243, 5, 1970],
[55, 60, 9, 4, 142, 16, 17, 358, 17, 8, 58, 1066, 8, 14, 101],
[41, 136, 231, 264, 4, 14, 178, 21, 863, 1380, 8, 191, 142],
[36, 16, 2, 747, 7, 24, 14, 2, 423, 8, 14, 1043, 4, 8, 736],
[9, 267, 103, 11, 65, 5, 1971, 863, 170, 729],
[],
[288, 14, 6, 1381, 864, 3, 10, 13, 6, 179, 353, 576, 20, 2],
[745, 306, 31, 30, 375, 5, 215, 55, 317, 11, 1972, 81],
[101, 25, 2, 265, 3, 4, 8, 259, 19, 22, 1973, 135, 5, 2, 33, 159],
[31, 837, 2, 33, 159, 14, 720, 54, 4, 2, 33, 560, 450, 14],
[501, 21, 2, 412, 243, 17, 124, 81, 143, 71, 1067, 192, 214, 3],
[63, 2, 186, 386, 567, 15, 114, 14, 29, 346, 17, 24, 124, 114],
[4, 15, 1382, 145, 185, 1383, 16, 9, 32, 3],
[],
[17, 8, 10, 256, 213, 18, 421, 1068, 4, 11, 207, 164, 1974],
[8, 14, 39, 5, 18, 577, 11, 1069, 748, 18, 99, 277, 14, 16, 8],
[23, 1975, 826, 69, 2, 307, 81, 11, 16, 749, 15, 117, 107, 135, 60],
[1384, 3, 8, 10, 5, 55, 13, 23, 134, 5, 2, 1976, 149, 11],
[18, 326, 4, 23, 150, 5, 2, 645, 1385, 16, 1386, 12, 107],
[5, 21, 2, 636, 1977, 12, 215, 6, 510, 7, 1978, 1979, 11, 2],
[307, 96, 417, 1070, 11, 2, 1980, 19, 1981, 1982, 57, 6, 1332],
[7, 1983, 1984, 4, 319, 46, 6, 1384, 1985, 227, 8, 191],
[156, 36, 16, 8, 14, 11, 2, 389, 7, 385, 97, 8, 23, 1986, 61, 8],
[14, 851, 231, 264],
[],
[34, 208, 15, 578, 228, 29, 94, 3, 10, 13, 17, 8, 750, 41, 303],
[5, 215, 18, 77, 36, 34, 189, 26, 1987, 25, 9, 101, 15, 359, 60],
[235, 1988, 11, 82, 405, 385, 16, 126, 26, 6, 354, 105, 5, 26, 229],
[227, 355, 32, 354, 5, 162, 3],
[],
[103, 57, 8, 161, 245, 1387, 41, 11, 2, 389, 6, 33, 77],
[72, 4, 8, 750, 751, 5, 165, 36, 38, 9, 14, 20, 99, 8, 63],
[9, 89, 26, 6, 1989, 28, 1990, 31, 57, 8, 730, 92, 346],
[8, 14, 101, 4, 8, 191, 156, 36, 16, 9, 14, 108, 6, 119, 16, 23],
[1068, 11, 50, 55],
[],
[752, 9, 26, 7, 62, 152, 101, 3, 63, 13, 731, 327, 5, 24, 119],
[355, 32, 29, 36, 7, 2, 77, 40, 106, 16, 15, 166, 91, 30],
[710, 9, 117, 308, 20, 62, 451, 255, 48, 1991, 11, 303, 3, 29, 8],
[78, 1992, 119, 45, 12, 47, 2, 77, 36, 7, 24, 389, 15, 286, 30, 546],
[7, 1388, 41, 106, 1389, 119, 3, 13, 63, 24, 89, 26, 2, 137],
[77, 7, 753, 5, 6, 119, 8, 23, 114, 287, 110, 6, 105, 124, 31],
[8, 730, 404, 275, 11, 18, 1993, 1994, 1995, 390, 119, 7],
[6, 119, 5, 6, 119, 6, 119, 1389, 119, 3, 2, 119, 113, 20, 18, 190],
[1996, 4, 177, 5, 18, 5, 1390, 19, 42, 7, 73, 33, 163],
[31, 9, 10, 155],
[],
[1071, 9, 268, 579, 636, 3, 63, 13, 34, 1997, 145],
[6, 865, 119, 150, 123, 19, 580, 2, 1391, 3, 25, 19, 22],
[18, 1014, 7, 581, 13, 23, 48, 30, 1392, 1072, 92, 144, 1393],
[211, 23, 563, 29, 8, 78, 54, 1998, 1999, 1394, 2000, 3, 97],
[14, 2, 99, 582, 11, 18, 865, 1073, 370, 2, 119, 285, 6],
[745, 2001, 36, 7, 2, 748, 4, 177, 5, 2002, 22, 123, 19, 1395],
[197, 15, 511, 67, 646, 3, 228, 13, 267, 344, 16, 8, 23, 1022],
[2, 186, 2003, 1396, 34, 84, 1362, 12, 300, 50, 318, 3],
[],
[393, 50, 318, 3, 228, 2, 119, 11, 6, 754, 2004, 109, 752],
[12, 50, 318, 43, 12, 52, 70, 3],
[],
[198, 301, 27, 3, 10, 13, 11, 6, 2005, 128, 647, 26, 755],
[41, 9, 4, 193, 15, 208, 15, 58, 1074, 12, 457, 138, 380, 15, 91, 512],
[222, 6, 554, 5, 318, 43, 12, 58, 108, 66, 18, 8, 32, 110, 6, 171, 1397],
[105, 3, 13, 53, 21, 200, 5, 55, 17, 8, 750, 2006, 41, 11, 2],
[389, 81, 8, 2007, 1398, 29, 1399, 60, 2, 866, 2008, 18, 867, 4],
[1075, 18, 283, 4, 8, 32, 110, 6, 627, 2009, 105, 5, 1076, 4, 857],
[110, 6, 860, 42, 25, 1400, 832, 206, 15, 511, 67, 646, 3, 228],
[13, 54, 25, 24, 65, 2, 119, 14, 2010, 22, 123, 4, 8],
[199, 726, 9, 89, 26, 415, 426, 394, 201, 308, 41, 18, 62],
[102, 43, 512, 190, 27, 3],
[],
[394, 266, 3, 228, 2, 119, 79, 14, 648, 40, 5, 2, 223, 7, 44],
[456, 513, 43, 15, 59, 308, 21, 110, 6, 583, 457, 2011, 330, 2012],
[318, 2013, 281, 2014, 143, 85, 299, 70, 294, 2, 378, 54, 3],
[],
[34, 201, 266, 3, 10, 13, 11, 6, 129, 382, 5, 306, 2, 583, 7],
[458, 584, 12, 71, 12, 849, 7, 7, 1077, 3, 2, 119, 75, 27],
[447, 29, 13, 53, 21, 514, 868, 32, 110, 6, 627, 33, 1401, 276],
[457, 240, 15, 166, 50, 5, 1074, 12, 6, 33, 495, 2015, 2016, 12],
[47, 19, 206, 110, 144, 2017, 1402, 574, 4, 553, 756, 143, 61],
[12, 1078, 46, 4, 553, 649, 39, 4, 511, 25, 73, 1403, 4, 22, 1058],
[7, 143, 15, 181, 302, 200, 7, 46, 4, 9, 1404, 5, 6, 2018],
[12, 47, 4, 37, 869, 145, 29, 1405, 145, 818, 6, 2019, 2020, 37],
[869, 9, 2021, 22, 2, 2022, 4, 206, 171, 3, 228, 13, 11, 6, 1406],
[128, 230, 344, 224, 426, 9, 54, 3, 25, 2, 119, 14, 1388],
[170, 100, 18, 17, 504, 17, 9, 58, 107, 4, 483, 84, 6, 2023, 11],
[2, 389, 17, 9, 53],
[],
[29, 8, 289, 2024, 120, 9, 2025, 171, 45, 150, 135, 54, 4, 175],
[201, 308, 41, 318, 28, 1077, 406, 43, 12, 85, 50, 46, 3, 61, 2],
[119, 161, 24, 9, 263, 121, 4, 750, 485, 135, 5, 18, 73],
[283, 14, 84, 870, 19, 1079, 13, 63, 4, 9, 10, 11, 6, 281],
[648, 109, 1080, 290, 116, 5, 2, 871, 4, 57, 187, 167, 12, 82],
[581, 4, 872, 579, 239, 9, 32, 15, 1407, 318, 4, 1077, 3],
[],
[9, 14, 264, 65, 5, 107, 25, 2, 389, 14, 205, 84, 757, 19, 2],
[427, 4, 873, 16, 23, 826, 69, 9, 64, 52, 6, 874, 4, 6, 331],
[6, 585, 4, 76, 1081, 4, 712, 90, 234, 459, 13, 838, 2],
[77, 4, 2, 332, 395, 750, 5, 2, 871],
[],
[],
[],
[],
[388, 2026, 6, 1082, 650, 4, 6, 144, 875],
[],
[35, 52, 266, 6, 354, 151, 395, 16, 1408, 21, 2, 1004, 2],
[427, 19, 2027, 2028, 2, 873, 19, 98, 1083, 2029, 316],
[5, 46, 4, 22, 2030, 1409, 1084, 4, 876],
[],
[2, 99, 252, 7, 182, 14, 92, 5, 116, 493, 54, 35, 23, 6],
[2031, 41, 24, 4, 120, 6, 414, 384, 9, 177, 84, 819],
[5, 13, 5, 215, 55, 261, 2032, 19, 46, 17, 43, 8, 23],
[2033, 46, 22, 18, 326, 266, 8, 23, 84, 6, 144, 877, 19, 2],
[585, 79, 20, 147, 263, 1085, 4, 59, 108, 95, 34, 286, 1410, 192],
[12, 4, 89, 47, 2034, 4, 24, 13, 59, 27, 1086, 146],
[1411, 92, 218, 9, 14, 4, 17, 2, 585, 2035, 2036, 5, 167, 73],
[855, 64, 14, 48, 102, 5, 26, 10],
[],
[20, 147, 2, 119, 79, 177, 5, 26, 6, 500, 7, 1412, 343, 46],
[289, 36, 1413, 40, 22, 7, 12, 4, 552, 5, 70, 187, 191, 165, 12],
[493, 244, 3, 35, 22, 254, 40, 20, 149, 11, 6, 141, 1414, 19, 2, 119],
[11, 2, 494, 13, 329, 18, 163, 305, 2037, 21, 9, 25, 8, 199],
[229, 8, 59, 1020, 6, 1383, 2038, 43, 8, 75, 27, 116, 493, 30, 191],
[],
[2039, 3, 10, 2, 119, 19, 76, 651, 279, 584, 12, 22, 503, 24],
[32, 2, 2040, 105, 15, 47, 360, 22, 121, 43, 12, 242, 580],
[2, 1391, 1415, 747, 14, 2041, 60, 2, 2042, 14, 191, 2043],
[5, 60, 2, 636, 79, 878, 2044, 4, 23, 134, 7, 624, 94],
[2045, 5, 2046, 4, 2047, 1416, 4, 1417, 2, 1418, 7],
[1419, 4, 1420, 3],
[],
[2048, 3, 10, 2, 585, 19, 6, 2049],
[],
[34, 511, 67, 646, 3, 10, 2, 119, 879, 31, 30, 652, 1087],
[12, 327, 3],
[],
[393, 15, 3, 10, 2, 585, 267],
[],
[34, 63, 12, 75, 3, 10, 2, 119, 3, 15, 1421, 1416, 4, 1417],
[2, 1418, 7, 1419, 4, 1420, 2050, 25, 118, 4, 212, 2051],
[2, 2052, 1422, 7, 2053, 142, 9, 1423, 3],
[],
[1424, 38, 3, 10, 2, 874],
[],
[1424, 9, 3, 2, 119, 168, 190, 2054, 361, 182, 12, 47, 38],
[9, 515, 3],
[],
[34, 47, 38, 9, 515, 122, 244, 61, 15, 215, 6, 105, 3, 10, 2],
[874, 196, 569, 6, 1088, 28, 6, 2055, 2, 252, 32, 38, 75, 2],
[1422, 215, 3],
[],
[2, 119, 75, 27, 516, 24, 252, 31, 1425, 53, 21, 3, 142],
[9, 1423, 5, 107, 19, 2056, 2057, 5, 1089, 580, 4, 1426, 118, 2],
[1090, 2058, 2059, 20, 99, 14, 2060, 31, 2, 2061, 7, 44],
[2062, 92, 71, 12, 205, 21, 101, 82, 171, 3, 9, 460, 362],
[5, 13, 17, 9, 249],
[],
[513, 1409, 17, 214, 3, 10, 13, 11, 6, 653, 128, 160, 268, 491, 5],
[493, 70, 20, 22, 3],
[],
[498, 16, 749, 3, 10, 2, 331, 880, 2063, 5, 73, 231, 34, 1091],
[16, 2, 2064, 2065, 25, 2, 1092, 2066, 7, 102, 2067],
[1427, 3],
[],
[1428, 636, 3, 10, 2, 1081, 34, 85, 47, 2, 517, 7, 200],
[381, 144, 213, 4, 1429, 102, 15, 85, 461, 12, 45, 406, 3, 4],
[2, 1081, 2068, 40, 73, 104, 5, 2069, 6, 1430, 96, 7, 2, 90, 427],
[2070, 2071],
[],
[139, 15, 14, 178, 5, 95, 3, 10, 2, 331, 11, 76, 426, 128, 2072, 16],
[2, 349, 105, 5, 116, 290, 493, 59, 26, 6, 1082, 650, 3],
[],
[139, 32, 6, 1082, 650, 3, 10, 13, 27, 16, 8, 878, 94, 5, 47],
[31, 2, 331, 23, 2073, 17, 43, 9, 63, 16, 626, 296, 5, 327],
[4, 48, 42, 379, 177, 2074, 5, 95, 211],
[],
[210, 3, 10, 2, 331, 219, 349, 77, 5, 518, 9, 32, 5, 45, 9, 3, 4, 17],
[12, 174, 50, 5, 356, 2, 105, 422, 96, 2075, 162, 15, 126, 167],
[12, 92, 2, 331, 823, 9],
[],
[99, 9, 496, 36, 6, 650, 182, 11, 6, 225, 7, 2076, 219, 2077],
[2078, 268, 448, 3, 9, 10, 4, 57, 22, 2, 395, 52, 2079],
[634, 2, 182, 106, 4, 64, 64, 14, 48, 758, 136, 180, 4],
[170, 3, 31, 35, 78, 519, 61, 35, 654, 4, 304, 72, 61, 35],
[654, 29, 16, 9, 14, 27, 1093, 5, 47, 61, 2, 650, 14, 123, 227],
[61, 35, 23, 134, 519, 200, 76, 1431, 28, 29, 4, 52, 84, 493, 54],
[2, 331, 315, 289, 36, 219, 650, 32, 123, 3, 4, 35, 22, 757],
[121, 9, 1432, 4, 714, 131, 79, 520, 1433, 3],
[],
[24, 252, 2, 331, 58, 27, 447, 146, 6, 129, 353, 7, 63],
[4, 9, 254, 25, 6, 144, 65, 19, 42, 725, 1094, 173, 73, 1434],
[2, 1435, 11, 97, 12, 1351, 66, 2080, 11, 2, 817],
[7, 118, 188, 2, 428, 383, 11, 360, 20, 147, 2, 331, 10],
[1436, 520, 1433, 4, 22, 89, 56, 881, 3],
[],
[131, 79, 32, 5, 314, 2, 881, 3, 84, 6, 759, 7, 1095, 257],
[],
[210, 8, 7, 182, 3, 10, 2, 331, 882, 5, 13, 19, 42, 725],
[4, 2, 332, 395, 20, 149, 757, 121, 18, 2081, 36, 11, 6, 883],
[77, 2082, 881, 3],
[],
[13, 23, 48, 277, 38, 5, 45, 4, 11, 2083, 8, 153, 18, 226, 11, 18],
[548, 4, 2084, 36, 6, 418, 7, 1437, 1438, 2, 1069, 748, 23],
[27, 115, 69, 9, 4, 1096, 46, 121, 17, 881, 64, 14, 655, 42],
[6, 656, 22, 121],
[],
[131, 8, 89, 56, 6, 2085, 55, 12, 47, 3, 10, 2, 119],
[],
[361, 182, 3, 2, 331, 168, 30, 1097, 139, 379, 56, 12, 115, 11],
[67, 548, 3, 37, 53, 21, 362, 5, 13],
[],
[884, 6, 1098, 3, 10, 13, 719],
[],
[2086, 9, 123, 106, 3, 10, 2, 331],
[],
[57, 35, 22, 757, 121, 18, 149, 102, 188, 2, 331, 880],
[2087, 2, 1098, 280, 394, 511, 67, 2088, 7, 24, 2089],
[2090, 4, 61, 9, 23, 348, 24, 885, 1099, 35, 22, 1100],
[],
[13, 63, 2, 332, 105, 30, 1439, 31, 35, 22, 113, 29, 1101],
[16, 8, 75, 27, 760, 5, 2091, 4, 17, 8, 58, 27, 91, 7, 211],
[5, 95, 8, 1102, 886, 4, 194, 2, 1098, 151, 17, 1103, 17, 8],
[58],
[],
[2, 158, 105, 14, 5, 251, 2, 1437, 24, 1440, 96, 1104, 4],
[761, 17, 2, 141, 427, 2092, 16, 35, 58, 27, 1354],
[2093, 4, 2, 346, 2094, 1105, 4, 23, 5, 26, 2095, 21, 2, 135],
[227, 9, 14, 123, 20, 147, 4, 35, 254, 40, 54, 11, 6, 1414, 4],
[2096, 2, 119, 5, 167, 46, 245, 102],
[],
[127, 2097, 5, 167, 70, 67, 581, 12, 47, 3, 10, 13, 81, 239],
[9, 32, 12, 1407, 657, 4, 1441, 3, 8, 202, 11, 6, 1106, 200, 344, 16, 9],
[59, 26, 426, 54],
[],
[2098, 32, 6, 144, 4, 6, 1107, 875, 3, 10, 2, 119, 362, 5, 13, 4],
[1108],
[],
[160, 32, 6, 144, 456, 320, 3, 10, 13, 151, 40, 19, 238, 20],
[2, 2099, 456, 131, 239, 45, 12, 762, 9, 1107, 3, 4, 8, 329, 21, 858],
[41, 9, 188, 2, 119, 14, 753, 29, 16, 18, 277, 7, 2, 875, 14],
[245, 50, 24],
[],
[2100, 10, 5, 6],
[119, 16, 37],
[887, 11, 2],
[240],
[299, 290],
[271, 107, 5],
[888, 15, 126],
[2101],
[12, 150],
[187, 222, 48],
[2102, 175],
[89, 56, 6],
[586, 25],
[415, 24],
[738, 224],
[155],
[5, 45],
[10, 2],
[119, 5, 2],
[2103, 110],
[6, 586],
[171, 641],
[19],
[48, 220],
[28, 889],
[59, 26],
[1442],
[457],
[890],
[187, 26],
[889, 187],
[26, 220],
[10],
[2104],
[218, 1443],
[187],
[356, 2],
[332],
[747],
[4],
[2105],
[12],
[5],
[2106, 3],
[],
[],
[127, 71, 27, 1109, 3, 10, 2, 119, 5, 13, 848, 139, 71, 12],
[425, 7, 3],
[],
[34, 511, 67, 646, 3, 10, 13, 30, 1444, 127, 23, 115, 5, 2, 2107],
[1445, 15, 91, 3],
[],
[34, 23, 27, 3, 228, 2, 119, 847, 4, 30, 462],
[],
[390, 1446, 3, 10, 13, 330, 503, 5, 165, 55, 1405, 4, 151],
[305, 41, 18, 197, 45, 299, 70, 392, 5, 2108, 9, 3],
[],
[34, 189, 45, 155, 7, 2, 225, 3, 10, 2, 119, 205, 39, 4, 717],
[170, 127, 2109, 70, 60, 261, 110, 638, 3],
[],
[34, 300, 429, 9, 3, 1110, 186, 13, 131, 250, 29, 891, 426],
[12, 47, 3],
[],
[2, 119, 108, 2110, 11, 763],
[],
[892, 150, 135, 4, 764, 67, 521, 3, 13, 289, 120, 9, 4, 2],
[522, 22, 1111, 11, 759, 363, 242, 45, 3, 31, 2, 119, 108, 463],
[73, 104, 765, 4, 411, 6, 33, 2111],
[],
[139, 6, 1112, 9, 342, 744, 3, 766, 2, 585, 17, 191, 17, 9, 14, 84],
[36, 7, 410, 4, 76, 218, 1113, 194, 2, 444, 7, 280, 5, 18],
[2112, 893, 82, 171, 299, 24, 26, 6, 1073, 5, 12, 114, 5, 2113],
[67, 767, 3, 894, 67, 895, 1394, 3, 10, 2, 768, 1113, 6, 33],
[2114, 658, 244, 5, 356, 2, 2115, 7, 76, 2116, 3],
[],
[34, 208, 15, 23, 457, 380, 106, 15, 47, 15, 45, 3, 10, 13, 711, 2117],
[659, 11, 660, 2118, 191, 756, 9, 135, 3],
[],
[81, 79, 32, 380, 43, 15, 174, 1114, 5, 377, 2, 252, 3, 10, 2],
[585],
[],
[13, 168, 514, 25, 8, 14, 330, 503, 5, 308, 41, 18, 2119],
[2120, 457, 138, 4, 857, 110, 6, 860, 42, 25, 1400, 832, 12],
[181, 91, 4, 206, 15, 208, 12, 58, 66, 18, 120, 2, 427, 239],
[1019, 251, 6, 33, 1447, 17, 191, 17, 172, 20, 9, 3],
[],
[24, 1099, 1440, 6, 1306, 1448, 343, 2, 395, 96, 7, 2],
[427, 373, 72, 20, 149, 42, 218, 2121, 78, 2122, 295, 39, 30],
[1115, 1116, 34, 415, 89, 26, 205, 709, 2, 715, 279],
[268, 1117, 82, 1449, 3, 4, 6, 2123, 289, 36, 11, 6, 648, 109, 5],
[73, 417, 284, 170, 82, 1048, 145, 264, 65, 12, 52, 22, 11, 2124, 3],
[21, 1450, 2125, 35, 22, 769, 72, 4, 13, 14, 191, 304, 746],
[],
[34, 208, 15, 578, 1118, 380, 3, 8, 10, 5, 55, 11, 6, 653],
[128, 1451, 743, 5, 50, 18, 40, 106, 4, 130, 229, 857, 2, 349],
[138, 11, 2, 549, 206, 82, 171, 380, 15, 238, 43, 15, 189, 214, 66, 12],
[62, 102, 3, 4, 106, 186, 13, 78, 5, 1053, 54, 25, 8, 199, 30],
[1452, 4, 281, 2126, 11, 6, 33, 188, 227, 8, 54, 161],
[6, 33, 1054, 7, 1453, 11, 2, 490, 4, 8, 113, 39],
[514, 200, 1030, 16, 2, 119, 23, 505, 44, 371, 4, 14, 443],
[135, 5, 764, 44, 521],
[],
[],
[],
[],
[388, 2127, 2, 112, 2128, 11, 6, 33, 333],
[],
[9, 14, 2, 157, 112, 1368, 485, 135, 54, 4, 151],
[305, 41, 17, 9, 53, 17, 43, 9, 23, 1023, 245, 4, 8, 161],
[9, 1055, 5, 295, 219, 132, 2, 132, 206, 82, 171, 867, 206],
[82, 1083, 4, 1024, 1019, 116, 70, 661, 17, 229, 17, 1454, 71],
[1454, 291, 117, 15, 56, 736, 46, 15, 238, 3, 13, 1119, 11, 6],
[164, 16, 9, 14, 151, 25, 2, 423, 4, 2, 734, 7, 157, 735, 391],
[4, 8, 30, 179, 2129, 78, 1120, 41, 25, 46, 31, 35, 52],
[1455, 5, 26, 275, 355, 177, 5, 56, 505, 896, 18, 897, 11],
[2, 389, 4, 2, 129, 449, 19, 2, 412, 243, 4, 2, 33, 159],
[23, 898, 2130],
[],
[30, 191, 2, 112, 487, 13, 17, 8, 53, 1120, 41, 4],
[289, 36, 5, 18, 11, 76, 755, 128, 210, 1121, 899, 38, 71, 12, 770],
[36, 106, 900, 709, 24, 164, 4, 756, 70, 6, 734, 7, 391, 4, 6, 423],
[1456, 101, 3, 4, 13, 14, 29, 94, 576, 16, 8, 259, 72, 20, 149],
[11, 2, 771, 9, 2131, 5, 146, 303, 5, 518, 2, 1122, 9],
[23, 156],
[],
[587, 194, 70, 25, 44, 2132, 3, 8, 10, 5, 55, 17, 8, 259, 270],
[571, 2133, 26, 61, 37, 2134, 36, 79, 15, 286, 31, 588, 334, 222, 118],
[44, 423, 4, 391, 16, 32, 43, 15, 117, 215, 46, 3, 17, 8, 10, 24, 8],
[125, 173, 6, 2135, 33, 240, 21, 2, 159, 7, 97, 14, 6, 495, 2136],
[1123, 19, 2, 378, 2137, 2138, 2139, 173, 9, 8, 53, 11, 146],
[1124, 4, 373, 2140, 11, 129, 822, 2141, 8, 166, 1089, 2],
[1125, 1121, 899, 4, 26, 263, 36, 7, 2, 240, 124, 8, 23, 142, 2],
[423, 4, 391],
[],
[270, 354, 9, 743, 3, 13, 10, 5, 55, 731, 26, 178, 1457, 25],
[6, 112, 15, 359, 2142, 26, 1050, 70, 21, 1457, 158, 3, 4, 8],
[78, 2143, 2, 225, 7, 105, 16, 59, 486, 3, 830, 13, 150],
[106, 1126, 4, 116, 503, 25, 67, 713, 443, 11, 6, 216],
[1076, 31, 224, 115, 5, 66, 16, 2, 119, 268, 116, 36, 108, 15, 85],
[91, 3, 13, 53, 21, 288, 1127, 299, 380, 639, 11, 2, 240, 43, 9],
[78, 1458, 278, 41, 50, 16, 3],
[],
[60, 24, 65, 8, 23, 142, 18, 77, 69, 6, 2144, 33, 335, 19, 6, 243],
[11, 2, 523, 4, 21, 9, 17, 8, 23, 2145, 6, 423, 4, 136, 28, 180, 2146],
[7, 836, 157, 735, 391, 8, 194, 39, 2, 423, 4, 6, 734, 7, 2, 391],
[4, 14, 103, 178, 5, 568, 2, 335, 61, 18, 570, 625, 173, 6, 33],
[416, 16, 589, 276, 2, 151, 412, 64, 14, 48, 1342, 24, 65],
[19, 2, 213, 1031, 70, 3, 31, 2147, 8, 2148, 9, 4, 153, 9],
[5, 18, 2149, 34, 47, 245, 772, 32, 229, 5, 486, 3, 8, 10],
[5, 55, 2150, 15, 251, 28, 843, 211, 29, 187, 103, 66, 38],
[24, 416, 464, 15, 45, 831, 553, 165, 70, 325, 141, 54, 25, 415],
[130, 84, 546, 7, 235, 110, 6, 836, 33, 105, 3],
[],
[9, 75, 29, 266, 4, 94, 1353, 192, 8, 23, 2151, 124, 8, 23],
[1459, 200, 2, 416, 8, 142, 18, 104, 2152, 419, 2, 2153],
[4, 23, 5, 1460, 5, 2154, 18, 564, 100, 235, 662, 8, 267, 153],
[40, 2, 416, 280, 5, 55, 272, 84, 244, 15, 831, 15, 733],
[325, 62, 102, 17, 9, 32, 15, 181, 116, 36, 20, 2, 159, 15, 45, 208, 15, 578],
[1459, 84, 29, 94, 3],
[],
[837, 9, 14, 185, 624, 5, 208, 16, 8, 53, 21, 387, 4, 387],
[4, 30, 191, 23, 5, 2155, 40, 21, 2, 1128, 11, 207, 216, 64],
[14, 27, 212, 335, 25, 24, 4, 8, 232, 2, 1129, 7, 501, 40, 19],
[42, 1130, 419, 2, 159, 4, 2, 90, 292, 1461, 121, 18, 104],
[317, 8, 53, 21, 387, 4, 17, 6, 147, 2156, 8, 153, 42, 292, 36],
[7, 2, 523, 4, 42, 421, 39, 2, 663, 4, 10, 5, 55, 409, 15],
[117, 45, 48, 102, 1131, 732, 38, 126, 773, 7, 70, 3],
[],
[1438, 25, 13, 2, 33, 2157, 416, 23, 101, 23, 73, 237, 1129],
[4, 8, 2158, 48, 562, 317, 9, 14, 30, 876, 4, 17, 64],
[177, 5, 26, 48, 225, 7, 901, 7, 18, 214, 205, 36, 7, 2, 335],
[54, 48, 238, 8, 199, 1462],
[],
[160, 14, 94, 2159, 20, 709, 3, 63, 186, 13, 774, 42, 396],
[330, 387, 562, 4, 1042, 4, 235, 1132, 41, 60, 832, 4],
[2160, 15, 480, 208, 15, 578, 336, 40, 16, 112, 820, 4, 193, 4],
[193, 145, 190, 234, 12, 47, 24, 225, 7, 326, 15, 45, 238, 38],
[117, 56, 563, 5, 70, 61, 15, 269, 5, 322, 2161, 2162, 15, 1463, 16],
[502, 7, 105, 114, 563, 4, 101, 106, 15, 286, 11, 2, 494, 7, 42],
[64, 296, 5, 26, 6, 370, 445, 41, 70, 16, 64, 296, 4, 61, 15],
[325, 39, 187, 775, 42, 31, 130, 590, 39, 101, 3, 8, 202, 11, 6, 1406],
[128, 1133, 465, 255, 48, 335, 5, 325, 39, 62, 102, 106, 3],
[],
[131, 57, 3, 63, 13, 1464, 15, 114, 116, 62, 1410, 192, 15, 286],
[101, 2163, 26, 6, 2164, 42, 77, 114, 5, 26, 76, 218, 1465, 31],
[57, 330, 5, 56, 407, 5, 509, 206, 15, 776, 50, 16, 3],
[],
[197, 12, 2165, 13, 3, 8, 902, 55, 270, 117, 12, 509],
[407, 11, 106, 239, 255, 351, 335, 25, 12, 4, 48, 335, 20, 22],
[25, 62, 1073, 1466, 3],
[],
[4, 29, 8, 53, 21, 777, 99, 42, 253, 4, 57, 2, 90, 4, 483],
[84, 6, 458, 7, 9, 729, 31, 120, 6, 414, 384, 8, 161],
[6, 109, 591, 4, 1134, 5, 552],
[],
[2166, 899, 1121, 899, 3, 10, 2, 109, 1467, 70, 82, 391, 24, 164, 3],
[57, 125, 6, 33, 1054, 7, 231, 21, 2, 1011, 13, 282, 9, 14],
[2, 112, 443, 5, 172, 25, 18, 4, 8, 1468, 236, 8, 463, 2],
[240, 84, 1135, 16, 8, 14, 101, 41, 6, 1322, 642, 17, 141],
[17, 2, 112, 4, 23, 48, 466, 5, 26, 344, 7, 9],
[],
[1327, 2, 112, 125, 39, 5, 2, 159, 4, 232, 5, 561, 9, 31, 17],
[2, 159, 413, 2167, 4, 273, 1130, 14, 1094, 504, 419, 9],
[16, 2168, 1469, 6, 2169, 13, 161, 9, 95, 5, 295, 364, 187],
[107, 121, 4, 116, 11, 20, 2, 523, 3],
[],
[288, 12, 2170, 63, 13, 4, 120, 452, 236, 8, 1463],
[8, 161, 2, 112, 103, 203, 2, 523, 8, 315, 861, 36, 18],
[226, 4, 156, 6, 1470, 11, 2, 279, 8, 75, 27, 116, 565, 7, 211],
[31, 8, 161, 6, 33, 778, 4, 6, 551, 4, 6, 1136, 7, 662, 412],
[100, 97, 8, 1471, 16, 9, 14, 103, 2171, 9, 23, 826, 69, 6],
[1472, 2172, 28, 245, 7, 2, 225],
[],
[158, 125, 76, 755, 109, 2, 862, 2173, 1473, 291, 71, 12, 3, 4],
[57, 6, 109, 8, 23, 114, 161, 124, 903, 57, 130, 106, 1070],
[25, 1474, 904, 905, 3],
[],
[2174, 25, 1474, 266, 3, 10, 2, 112, 462, 1137, 150, 4],
[392, 70, 36, 7, 24, 3, 906, 7, 102, 662, 412],
[],
[409, 167, 70, 1473, 1429, 16, 11, 2, 523, 3],
[],
[903, 145, 76, 292, 904, 905, 3, 37, 2175, 9, 2176, 3],
[],
[2177, 292, 12, 1475, 79, 214, 297, 42, 16, 324, 239, 9, 2178, 2, 332],
[523, 3],
[],
[903, 9, 464, 904, 905, 31, 145, 76, 292, 25, 22, 16, 3],
[],
[198, 145, 115, 48, 467, 64, 20, 62, 451, 107, 4, 222, 9, 170, 3],
[],
[64, 14, 6, 144, 360, 120, 24, 4, 13, 58, 108, 294, 2179],
[101, 4, 57, 110, 17, 903, 15, 85, 50, 9, 904, 905, 20, 22, 20],
[22, 3, 492, 17, 15, 167, 12, 12, 2180, 3, 4, 20, 147, 8, 861, 36, 18],
[226, 54, 4, 156, 207, 1470, 11, 2, 279, 24, 65, 64, 52],
[136, 33, 2181, 4, 102, 906, 7, 662, 412, 139, 6, 510, 7],
[1472, 2182, 64, 89, 26, 3, 63, 13, 34, 238, 38, 824, 45],
[158, 17, 25, 2183, 70, 36, 7, 2, 523, 15, 108, 208, 35, 58, 130],
[229, 15, 85, 454, 5, 744, 11, 106, 62, 1025, 3],
[],
[8, 383, 25, 96, 65, 146, 907, 211, 102, 20, 147, 125, 6],
[2184, 7, 33, 2185, 4, 2, 828, 7, 6, 179, 298, 1095],
[22, 261, 468, 8, 156, 36, 2, 213, 2186, 2, 90],
[2187, 239, 15, 578, 5, 1360, 31, 42, 908, 115, 2, 90, 333],
[756, 9, 106, 2188, 106, 153, 1138, 39, 20, 24, 835, 48, 2189, 1138],
[468, 99, 35, 85, 846, 200, 264, 244, 193, 206, 824],
[45, 122, 244, 85, 26, 660, 106, 333, 1020, 565, 7, 24],
[2190, 126, 2, 631, 1476, 371, 16, 1477, 909, 206, 145, 443],
[40, 408, 664, 3, 6, 665, 1136, 409, 79, 75, 16, 9, 14, 333, 15],
[554, 2191, 5, 107, 40, 2, 663, 2192, 15, 733, 12, 45, 9, 16, 15],
[201, 57, 908, 5, 107, 40, 106, 333, 2, 910, 869, 250, 5],
[107, 40, 2, 663, 3],
[],
[197, 29, 908, 115, 5, 150, 40, 2, 663, 520, 37, 3, 10, 13, 5],
[55, 2193, 35, 491, 5, 153, 355, 173, 333, 15, 342, 26, 11],
[908, 469, 25, 6, 179, 353, 24, 2194, 32, 1381, 5, 26, 229, 31],
[15, 91, 15, 117, 1139, 6, 33, 3],
[],
[8, 779, 18, 421, 17, 328, 40, 2, 663, 17, 8, 58, 4, 383],
[236, 8, 161, 6, 33, 2195, 8, 446, 1066, 7, 38, 225, 9, 14],
[2196, 4, 2197, 41, 11, 2, 663, 316, 1140, 18, 57],
[280, 5, 55, 1141, 32, 333, 3, 8, 285, 42, 666, 1139, 4, 383, 5],
[66, 38, 59, 486, 158],
[],
[2, 99, 105, 8, 161, 14, 6, 645, 759, 7, 868, 575, 333, 3],
[57, 2, 862, 109, 634, 2198, 118, 12, 60, 2, 1312, 3, 57],
[360, 4, 57, 207, 761, 7, 1095, 894, 39, 44, 104, 2199],
[101, 85, 2200, 118, 92, 14, 9, 218, 911, 38, 563, 5, 12, 167],
[290, 22, 41, 9, 3],
[],
[147, 125, 6, 33, 1478, 1479, 109, 272, 333, 3, 63],
[13, 198, 15, 351, 47, 48, 102, 2201, 2202, 130, 334, 101, 31, 130],
[6, 353, 185, 2203, 5, 167, 12, 22, 15, 47, 32, 245, 1480, 20, 70],
[50, 6, 2204, 11, 2, 418, 4, 39, 15, 575, 50, 6, 780, 2205, 3],
[],
[592, 12, 75, 218, 911, 3, 10, 2, 522],
[],
[394, 89, 1350, 2, 240, 40, 3, 10, 2, 862, 109, 4, 13, 289],
[36, 17, 665, 17, 8, 58, 217, 12, 45, 187, 209, 380, 20, 12, 3],
[],
[64, 14, 6, 912, 360, 781, 4, 13, 63, 5, 55, 34],
[238, 38, 35, 126, 45, 158, 43, 35, 23, 62, 1142, 1127, 222, 2],
[631, 72, 3, 120, 6, 216, 28, 136, 35, 78, 1143, 41, 54, 4],
[13, 161, 2, 112, 95, 390, 1481, 126, 45, 5, 347, 19, 3],
[],
[390, 1481, 7, 38, 3, 63, 13, 31, 8, 23, 27, 144, 5, 913],
[25, 2, 158, 164, 6, 1482, 7, 33, 1483, 125, 1484, 11, 20, 2],
[523, 4, 96, 7, 46, 1485, 18, 11, 2, 283, 782, 153, 6, 639, 5, 24, 3],
[8, 10, 5, 55, 4, 470, 36, 1486, 334, 27, 45, 16, 54, 3],
[97, 1487, 207, 912, 360],
[],
[13, 487, 19, 96, 783, 16, 2, 1483, 52, 22, 362, 69],
[33, 1144, 17, 35, 914, 21, 2, 1128, 4, 6, 495, 277, 125, 69, 18],
[104, 217, 15, 251, 42, 7, 256, 1144, 3, 8, 63, 196, 229, 5, 165],
[96, 306, 11, 82, 324, 4, 17, 9, 181, 1039, 165, 70, 562, 9, 89],
[165, 70, 1042, 15, 359, 3],
[],
[29, 8, 2206, 42, 7, 2, 1144, 4, 14, 1488, 5, 215, 16, 8],
[78, 863, 1126, 17, 191, 17, 8, 14, 346, 244, 5, 116, 260],
[2, 159, 8, 259, 36, 7, 2, 240, 4, 142, 84, 6, 915, 7, 33],
[873, 4, 427, 452, 591, 2, 186, 33, 784, 333, 14],
[11, 2, 494, 235, 916, 39, 60, 136, 667, 668, 79, 52, 1489, 9],
[245, 36, 7, 6, 416, 35, 22, 156, 6, 1490, 20, 13, 2, 164, 8],
[524, 31, 8, 259, 72, 17, 504, 17, 8, 58, 4, 191, 142, 55],
[1491, 11, 6, 2207, 525],
[],
[219, 99, 105, 224, 115, 5, 45, 3, 10, 13, 5, 55, 17, 8, 1492],
[41, 11, 2, 525, 917, 5, 325, 5, 82, 137, 324, 54, 4, 2, 632],
[105, 32, 5, 215, 82, 77, 69, 16, 1357, 265, 15, 91, 16, 126, 26],
[2, 349, 918, 3],
[],
[9, 741, 76, 1493, 918, 48, 913, 4, 30, 1376, 4, 1102],
[2208, 2, 108, 919, 14, 16, 8, 23, 27, 2, 1494, 277],
[92, 5, 209, 41, 9, 4, 188, 8, 14, 2209, 41, 305, 343],
[2, 593, 6, 33, 666, 1495, 103, 123, 18, 104, 156, 18, 172, 39, 11, 6],
[129, 382],
[],
[76, 2210, 669, 14, 151, 40, 20, 18, 19, 141, 121, 163, 4],
[2211, 1496, 36, 42, 1145, 303, 5, 2212, 18, 2213, 33, 105, 3],
[10, 13, 11, 6, 1497, 128, 4, 8, 232, 504, 5, 2214, 5, 9, 31],
[8, 14, 2215, 576, 22, 2, 65, 20, 2, 63, 16, 9, 174, 26],
[1146, 11, 97, 749, 9, 59, 26, 30, 710, 5, 251, 18, 39, 11, 2216, 7],
[22, 18, 1497],
[],
[351, 1411, 38, 8, 75, 8, 1147, 39, 6, 33, 262, 7, 920, 4],
[916, 9, 36, 5, 2, 669, 2217, 2, 669, 630, 69, 2, 279, 72],
[22, 73, 231, 20, 149, 19, 6, 2218, 7, 1027, 4, 2219, 20, 2, 920],
[4, 156, 461, 5, 2220, 9, 57, 13, 2221, 319, 6, 129, 1498],
[5, 365, 55, 100, 235, 900, 123, 4, 2, 164, 8, 524, 21, 2],
[90, 253, 2, 669, 156, 207, 1490, 20, 2, 920, 4, 2222, 104],
[123, 2223, 11, 73, 382, 5, 116, 565, 7, 9, 57, 13, 425, 9, 14],
[30, 50, 404, 6, 350, 7, 508, 19, 6, 2224, 2225, 4, 1045, 345],
[164, 5, 26, 2226, 203, 73, 231, 259, 121, 2, 1498, 54, 57],
[2, 669, 78, 6, 2227, 7, 885, 1499, 20, 2, 920, 519, 6, 30],
[33, 77, 2228, 526, 65, 4, 6, 144, 77, 135, 4, 2229, 2230],
[22, 2, 188, 236, 20, 147, 9, 254, 40, 6, 179, 77, 72, 1432, 19],
[73, 895, 1026, 36, 7, 73, 430, 4, 73, 129, 163, 200, 720],
[],
[24, 177, 5, 13, 6, 179, 444, 25, 483, 18, 864, 29, 8],
[209, 72, 20, 149, 4, 259, 236, 8, 14, 84, 546, 4, 36, 7, 890, 4],
[236, 2, 2231, 1495, 741, 84, 2232, 11, 2, 490],
[],
[81, 193, 38, 6, 171, 33, 669, 9, 14, 3, 10, 13, 17, 8, 2233],
[419, 6, 2234, 5, 428, 55, 4, 2235, 55, 19, 42, 7, 2],
[629, 34, 166, 56, 654, 2236, 9, 2237, 30, 94, 43, 43, 588],
[108, 134, 2, 137, 324, 5, 45, 9, 206, 171, 588, 358, 635, 16],
[224, 115, 5, 325, 39, 54, 299, 70, 66, 92, 32, 9, 5, 26, 823, 15],
[359, 15, 296, 5, 251, 28, 843, 245, 28, 90, 31, 2, 129],
[252, 32, 38, 3],
[],
[2, 129, 252, 320, 14, 38, 13, 113, 22, 121, 18, 20],
[2, 1338, 4, 2, 2238, 7, 921, 31, 8, 75, 27, 66, 211, 16],
[113, 50, 2, 137, 105, 5, 251, 28, 843, 203, 2, 2239],
[64, 14, 6, 141, 527, 387, 276, 18, 41, 2, 195, 785, 17],
[55, 4, 61, 8, 23, 113, 203, 9, 4, 21, 271, 821, 7, 9, 4],
[319, 9, 9, 1309, 5, 18, 16, 8, 174, 17, 122, 172, 4, 66, 38],
[14, 21, 2, 488, 7, 9],
[],
[8, 1500, 55, 39, 21, 1501, 4, 1005, 123, 2, 1148, 7, 2],
[527, 4, 18, 163, 1149, 887, 381, 7, 6, 141, 183],
[16, 14, 403, 21, 2, 488, 19, 73, 670, 1150, 786, 1502, 6, 144],
[787, 4, 777, 27, 2, 1494, 516, 7, 18, 28, 7, 211, 379],
[],
[],
[],
[],
[388, 2240, 1359, 100, 6, 183],
[],
[2, 183, 4, 13, 113, 20, 526, 90, 25, 96, 65, 11, 360],
[20, 147, 2, 183, 194, 2, 787, 36, 7, 73, 430, 4, 1503],
[18, 11, 6, 2241, 705, 109],
[],
[671, 71, 12, 3, 10, 2, 183],
[],
[24, 14, 27, 76, 1504, 1047, 25, 6, 458, 13, 168],
[190, 2242, 34, 15, 351, 47, 641, 103, 20, 1151, 20, 465, 15, 47],
[79, 15, 14, 61, 15, 115, 39, 24, 738, 31, 15, 91, 15, 89, 56, 134],
[505, 712, 642, 896, 57, 3],
[],
[139, 45, 12, 429, 60, 16, 3, 10, 2, 183, 2243, 1505],
[422, 3],
[],
[34, 181, 518, 573, 130, 344, 2244, 10, 13, 1152, 130, 27],
[573, 12, 66, 3],
[],
[34, 85, 66, 3, 10, 2, 183],
[],
[230, 344, 15, 181, 153, 9, 102, 1506, 3, 13, 168, 30, 652],
[567, 15, 181, 579, 9, 573, 5, 347, 19, 4, 235, 29, 298],
[424, 2245, 11, 6, 162, 32, 30, 1153, 3],
[],
[160, 594, 3, 10, 2, 183],
[],
[198, 301, 12, 528, 142, 9, 29, 193, 3, 10, 13, 131, 61, 12],
[56, 5, 471, 69, 6, 2246, 12, 126, 96, 162, 12, 47, 4, 57],
[120, 16, 69, 6, 2247, 15, 166, 91, 872, 482, 9, 6, 33],
[354, 201, 12, 3],
[],
[393, 6, 262, 3, 10, 2, 183],
[],
[198, 301, 67, 1396, 176, 26, 424, 3, 10, 13, 1154, 15, 47],
[32, 9, 59, 482, 30, 354, 5, 70, 3],
[],
[127, 3, 10, 2, 183, 1507, 671, 71, 12, 3],
[],
[97, 1155, 46, 135, 54, 5, 2, 274, 7, 2, 458],
[13, 199, 6, 33, 2248, 20, 2, 2249, 483, 110, 30],
[885, 1156, 4, 8, 779, 55, 39, 4, 10, 30, 1097, 34, 91],
[12, 296, 5, 167, 70, 79, 12, 71, 99, 3],
[],
[210, 3, 10, 2, 183],
[],
[106, 14, 207, 858, 252, 4, 17, 13, 58, 27, 91, 7, 62],
[179, 466, 4, 17, 2, 183, 177, 5, 26, 11, 6, 30, 1348],
[672, 7, 371, 8, 263, 170],
[],
[284, 135, 3, 2, 183, 289, 120, 18, 309, 245, 651],
[5, 95, 3],
[],
[24, 741, 2250, 320, 13, 263, 4, 125, 135, 54],
[],
[2251, 67, 767, 3, 10, 2, 183],
[],
[917, 16, 22, 3, 10, 13, 2252, 40, 18, 1508, 17, 122, 17, 8],
[58],
[],
[321, 3, 10, 2, 183],
[],
[13, 63, 8, 174, 17, 122, 2253, 17, 8, 23, 155, 379, 5, 45, 4],
[301, 120, 22, 9, 174, 167, 18, 245, 818, 907, 25, 96],
[384, 9, 2254, 170, 146, 753, 31, 20, 147, 9, 1509, 73],
[670, 194, 2, 787, 36, 7, 73, 430, 54, 4, 10, 592, 12, 91],
[250, 505, 45, 12, 3],
[],
[230, 344, 15, 286, 641, 3, 10, 13, 34, 181, 302, 143, 17, 15],
[269, 4, 15, 85, 365, 2, 195, 324, 25, 727, 384, 468, 3],
[],
[2255, 302, 38, 143, 3, 10, 2, 183],
[],
[198, 224, 232, 5, 95, 92, 1061, 2, 33, 1510, 2256, 31, 9, 22, 125],
[424, 3, 13, 168, 11, 6, 30, 653, 109],
...]
doc2 = [l for l in doc1 if len(l) > 2]
doc2
[[51, 1297, 273, 402, 11, 622, 60, 1298, 1299],
[24, 545, 32, 25, 2, 152, 7, 702, 1002, 20, 48, 814, 4, 19],
[480, 48, 1300, 1301, 12, 176, 340, 9, 314, 9, 170, 28],
[1302, 152, 9, 203, 2, 204, 7, 2, 51, 49, 258, 1003],
[19, 24, 545, 28, 815, 20, 703, 49, 341],
[1821, 273, 402, 11, 622],
[13, 14, 274, 5, 116, 30, 546, 7, 403, 60, 18, 481, 21, 2],
[1004, 4, 7, 404, 155, 5, 45, 149, 28, 704, 8, 23, 1005, 69, 2],
[370, 18, 481, 14, 816, 31, 9, 23, 48, 817, 28, 1303, 11],
[9, 81, 38, 32, 2, 152, 7, 6, 370, 3, 63, 13, 1822, 817, 28],
[29, 8, 14, 1006, 11, 18, 405, 371, 17, 122, 17, 8, 58, 25, 2],
[547, 162, 156, 18, 482, 30, 705, 4, 1007, 372, 2, 1304],
[7, 483, 6, 1823, 1824, 59, 26, 818, 2, 623, 7, 205, 39, 4],
[1305, 2, 1825, 61, 315, 6, 157, 112, 19, 1826, 163, 259],
[316, 60, 18],
[64, 14, 155, 29, 30, 1306, 11, 16, 1307, 75, 13, 91, 9, 29],
[30, 94, 36, 7, 2, 77, 5, 294, 2, 112, 95, 5, 295, 197, 171],
[206, 171, 15, 189, 26, 624, 3, 61, 8, 63, 9, 123, 1308, 9],
[1309, 5, 18, 16, 8, 296, 5, 56, 1827, 20, 24, 31, 20, 2, 65],
[9, 22, 177, 84, 819, 31, 61, 2, 112, 1828, 194, 6, 484],
[36, 7, 73, 1310, 548, 4, 113, 20, 9, 4, 57, 373, 21],
[13, 1311, 5, 18, 231, 25, 9, 1829, 706, 18, 371, 16, 8, 23],
[114, 124, 275, 6, 112, 19, 406, 6, 1310, 548, 28, 6, 484],
[5, 222, 36, 7, 9, 4, 1830, 19, 707, 8, 259, 706, 2, 1831],
[120, 9, 4, 1832, 14, 103, 11, 65, 5, 66, 9, 1833, 40, 6, 141],
[112, 820, 203, 2, 1312],
[11, 207, 164, 40, 53, 13, 120, 9, 114, 149, 1006, 92],
[11, 2, 549, 8, 14, 5, 116, 36, 54],
[2, 112, 820, 53, 1313, 21, 50, 6, 1834, 25, 96, 77, 4, 57],
[1314, 315, 40, 29, 315, 16, 13, 23, 27, 6, 164, 5, 91],
[41, 1835, 55, 124, 8, 142, 55, 1315, 40, 6, 30, 550],
[406, 2, 122, 14, 30, 550, 28, 8, 625, 30, 485, 25, 8, 23],
[1316, 7, 65, 17, 8, 53, 40, 5, 172, 41, 18, 4, 5, 238, 38, 14],
[178, 5, 486, 158, 99, 8, 232, 5, 172, 40, 4, 165, 36, 38],
[8, 14, 443, 5, 31, 9, 14, 185, 1008, 5, 66, 211, 57, 8],
[113, 20, 2, 821, 7, 2, 122, 4, 487, 16, 35, 52, 1009, 19],
[1317, 4, 370, 1318, 106, 4, 64, 8, 297, 1836, 4, 817],
[1837, 173, 1838, 8, 194, 40, 6, 1319, 100, 42, 7, 2, 1318, 17],
[8, 708, 9, 14, 1839, 1840, 1841, 31, 5, 18, 129],
[1842, 9, 14, 1843, 8, 75, 27, 50, 5, 1844, 2, 1319, 25, 822],
[7, 1845, 626, 29, 823, 5, 153, 9, 69, 42, 7, 2, 1317, 17],
[8, 625, 1010, 9],
[198, 3, 63, 13, 5, 55, 1320, 110, 6, 551, 17, 24, 15, 189],
[91, 155, 7, 1321, 40, 1011, 92, 1846, 824, 22, 91, 70, 20],
[709, 239, 15, 342, 95, 211, 41, 9, 212, 43, 15, 625, 72, 2, 488],
[7, 2, 240, 3, 97, 14, 30, 710, 825],
[40, 40, 40, 59, 2, 551, 114, 150, 5, 76, 223, 34, 238, 92],
[298, 1012, 224, 826, 60, 24, 65, 3, 8, 10, 711, 34, 89, 26, 205],
[1013, 276, 2, 1847, 7, 2, 827, 299, 70, 66, 16, 59, 26, 489],
[1322, 1012, 40, 15, 91, 3, 25, 12, 66, 13, 23, 1323, 712],
[143, 7, 24, 225, 11, 18, 407, 11, 2, 1848, 4, 374, 24],
[14, 27, 6, 30, 179, 444, 25, 1324, 72, 18, 1014, 17, 64],
[14, 48, 42, 5, 552, 5, 18, 317, 9, 14, 179, 1849, 5, 95, 9, 123],
[3, 1850, 241, 41, 2, 137, 490, 31, 57, 15, 238, 38, 1325],
[28, 1326, 224, 115, 5, 3, 13, 23, 48, 277, 38, 1325, 14, 28],
[1326, 406, 31, 63, 35, 52, 627, 1015, 213, 5, 95],
[1327, 8, 78, 54, 34, 238, 43, 15, 189, 551, 137, 260, 2],
[827, 92, 1016, 553, 491, 5, 150, 36, 343, 2, 278, 16, 713, 19],
[98, 408, 1851, 2, 1852, 15, 91, 3, 8, 14, 190, 375],
[64, 14, 48, 42, 1017, 24, 65, 17, 9, 300, 828, 20, 22, 2],
[137, 376, 3, 31, 15, 189, 56, 5, 377, 46, 38, 2, 378, 7, 2, 1018],
[32, 12, 47, 242, 1853, 32, 24, 628, 1854, 28, 1855, 3, 4],
[8, 232, 5, 1856, 17, 8, 249, 554, 1857, 17, 250, 1315],
[260, 2, 279, 45, 12, 91, 12, 58, 555, 9, 81, 38, 76],
[1858, 33, 829, 1019, 91, 70, 25, 714, 48, 553, 114, 45, 5],
[377, 301, 15, 189, 66, 9, 445, 39, 1013, 3],
[40, 40, 40, 64, 14, 155, 379, 5, 45, 29, 13, 191, 78],
[261, 54, 1859, 830, 70, 30, 94, 5, 715, 15, 166, 91, 3],
[380, 14, 2, 138, 34, 831, 824, 302, 18, 1860, 7, 1328, 20],
[233, 65, 380, 82, 171, 15, 208, 12, 52, 40, 106, 19, 70, 64, 71, 48],
[832, 11, 2, 279, 130, 344, 31, 12, 174, 1020, 6, 1021, 4, 241, 30],
[50, 6, 119, 12, 47, 31, 45, 318, 251, 833, 15, 238, 3, 4, 106, 13],
[78, 5, 116, 190, 705, 4, 53, 21, 280, 5, 55, 11, 6, 1861],
[225, 7, 77, 492, 318, 251, 833, 45, 318, 251, 833, 3, 4, 716, 492],
[833, 251, 318, 3, 25, 12, 66, 17, 8, 446, 447, 406, 252],
[9, 300, 94, 448, 97, 77, 8, 153, 9, 8, 199, 16, 8, 14, 1862],
[72, 4, 23, 103, 556, 5, 557, 16, 8, 14, 717, 226, 11, 226, 19],
[380, 4, 280, 5, 18, 30, 1329, 409, 380, 167, 70, 2, 1863],
[75, 12, 214, 251, 6, 1021, 3, 61, 315, 1330, 1330, 40, 8, 125, 173],
[6, 1864, 7, 1865, 4, 493, 629, 4, 2, 551, 14, 123],
[13, 14, 27, 6, 262, 1022, 4, 8, 630, 39, 21, 5, 18, 231, 11, 6, 164],
[8, 113, 39, 31, 9, 14, 22, 1008, 1866, 124, 18, 14, 207],
[144, 834, 4, 2, 157, 112, 14, 317, 11, 410, 1867, 40, 9],
[64, 14, 27, 6, 164, 5, 26, 1023, 170, 53, 13, 50, 2, 1331, 4],
[14, 103, 11, 65, 5, 294, 9, 95, 17, 9, 263, 6, 835, 197, 82, 718],
[4, 1024, 92, 624, 145, 205, 3, 8, 14, 316, 319, 9, 61, 8],
[263, 2, 835, 31, 2, 112, 14, 48, 1025, 5, 26, 275, 8, 142],
[55, 11, 6, 144, 281, 449, 97, 14, 1868, 39, 60, 6, 1332, 7, 1869, 1026],
[100, 2, 631],
[64, 52, 1333, 22, 121, 2, 449, 31, 35, 52, 22, 1870, 4, 61],
[13, 23, 134, 22, 2, 77, 40, 42, 253, 4, 39, 2, 90, 303, 345],
[159, 8, 411, 719, 40, 2, 494, 558, 92, 8, 14, 214, 5],
[116, 36, 54],
[315, 8, 125, 173, 6, 33, 180, 1334, 243, 22, 156, 7, 1871],
[412, 64, 14, 155, 21, 9, 559, 6, 836, 560, 450, 4, 273],
[99, 63, 14, 16, 9, 174, 1872, 5, 42, 7, 2, 1333, 7, 2, 449],
[31, 837, 406, 2, 1335, 52, 185, 141, 28, 2, 450, 14, 185, 346],
[31, 20, 62, 451, 9, 59, 27, 561, 62, 7, 46, 227, 21, 2, 632],
[65, 121, 8, 125, 173, 6, 281, 1873, 8, 23, 27, 487, 124, 4],
[319, 9, 14, 6, 33, 159, 41, 1874, 633, 264, 8, 232, 2],
[33, 560, 450, 11, 2, 1875, 4, 5, 18, 129, 1027, 9, 1876],
[13, 413, 2, 159, 4, 142, 16, 9, 838, 69, 6, 346, 834, 27],
[94, 562, 192, 6, 1877, 820, 8, 1878, 40, 4, 113, 634, 2, 834],
[69, 2, 1879, 265, 12, 214, 297, 92, 8, 1336, 5, 116, 36, 7],
[16, 1008, 449, 4, 1880, 41, 343, 381, 1337, 7, 495, 1338, 4],
[381, 1339, 1340, 31, 8, 58, 27, 212, 116, 18, 104, 260, 2],
[1881, 81, 212, 43, 82, 104, 59, 107, 260, 3, 63, 186, 13, 160],
[59, 26, 7, 30, 33, 152, 146, 82, 839, 206, 92, 15, 208, 15, 58],
[720, 39, 50, 6, 1028, 15, 91, 15, 58, 43, 15, 108, 282, 92, 5, 347, 3],
[25, 12, 66, 29, 298, 36, 7, 2, 77, 143, 23, 563, 1882],
[16, 13, 23, 556, 5, 91, 16, 30, 414, 143, 266, 52, 415],
[64, 177, 5, 26, 48, 152, 11, 452, 60, 2, 33, 159, 29, 8, 53],
[135, 5, 2, 243, 200, 1030, 8, 174, 215, 207, 450, 21, 9, 28, 20],
[62, 451, 6, 370, 7, 721, 25, 1341, 278, 39, 50, 1883, 24],
[65, 8, 142, 6, 33, 416, 21, 9, 840, 320, 14, 27, 106],
[124, 3, 10, 13, 4, 121, 2, 564, 7, 2, 416, 14, 6, 722],
[1342, 19, 2, 213, 1031, 1343, 1344, 1032, 21, 9, 11, 141],
[9, 14, 22, 30, 122, 5, 95, 1031, 70, 3, 31, 2, 1345, 33, 13, 14],
[27, 178, 5, 45, 16, 11, 6, 382, 321, 187, 172, 99, 3, 8, 10, 81],
[66, 372, 145, 496, 1885, 28, 1886, 25, 8, 23, 322, 712, 627],
[33, 1887, 41, 417, 79, 23, 115, 1888, 4, 1889, 39, 60, 1346],
[1347, 4, 90, 1348, 143, 22, 323, 35, 59, 27, 302],
[2, 723, 721, 98, 1349, 23, 841, 46, 110, 17, 16, 6, 1033, 547],
[1890, 126, 1350, 12, 43, 12, 565, 9, 185, 144, 4, 16, 43, 12, 724, 67],
[725, 30, 842, 19, 6, 1034, 9, 1351, 1891, 4, 8, 23, 114],
[635, 16, 43, 12, 843, 94, 100, 6, 416, 496, 1352, 3, 9, 32],
[480, 726, 5, 1892, 19, 12, 1353, 28, 1035],
[227, 24, 416, 14, 27, 496, 1352, 3, 29, 13, 844, 5, 1354],
[9, 4, 1036, 9, 30, 627, 9, 23, 11, 497, 6, 225, 7, 1355, 1893],
[7, 1894, 1895, 1896, 1897, 1898, 1899, 1900, 1901, 4, 547],
[1902, 1903, 8, 30, 191, 348, 9, 72],
[139, 6, 234, 566, 3, 10, 13, 34, 89, 26, 1341, 39, 50, 6],
[4, 29, 9, 14, 266, 8, 14, 101, 108, 727, 633, 264, 4, 18, 283],
[1356, 39, 20, 2, 63, 16, 8, 14, 101, 2, 137, 324, 25, 178],
[260, 2, 33, 159, 69, 16, 1357, 265, 99, 227, 8],
[383, 25, 6, 414, 384, 5, 66, 43, 8, 14, 178, 5, 1904, 62, 845],
[8, 199, 6, 33, 728, 41, 24, 567, 9, 174, 223, 12, 47, 3, 10],
[13, 5, 55, 498, 82, 178, 36, 729, 50, 6, 1037, 15, 238],
[38, 15, 166, 26, 50, 57, 3, 4, 8, 232, 5, 554, 38, 2, 1905, 7, 6],
[1037, 32, 50, 120, 2, 1037, 32, 1906, 36, 25, 8, 58, 27, 302],
[214, 404, 275, 110, 6, 105],
[120, 6, 188, 1036, 16, 155, 102, 563, 8, 1038, 21, 178],
[69, 2, 265, 20, 149, 31, 837, 25, 186, 13, 61, 8, 115, 5, 2],
[159, 8, 142, 8, 23, 635, 2, 33, 560, 450, 4, 61, 8],
[53, 135, 5, 2, 243, 25, 9, 8, 142, 8, 58, 27, 1039, 846],
[9, 8, 58, 66, 9, 84, 1907, 260, 2, 412, 4, 8, 232, 18],
[349, 5, 1908, 39, 42, 7, 2, 1040, 7, 2, 243, 31, 9, 14, 185, 1909],
[4, 61, 8, 23, 546, 55, 36, 19, 303, 2, 186, 33, 105],
[254, 40, 4, 228],
[284, 255, 48, 152, 11, 1358, 50, 16, 3, 10, 13, 5, 55],
[190, 847, 34, 1910, 12, 5, 568, 72, 24, 216, 3, 8, 569],
[285, 55, 30, 179, 1359, 374, 8, 30, 1911, 499, 9],
[4, 716, 8, 1912, 55, 29, 848, 17, 5, 1360, 385, 69],
[18, 163, 4, 149, 8, 730, 303, 5, 418, 18, 405, 718, 25, 404],
[1913, 55, 11, 6, 350, 7, 453, 8, 14, 1361, 419, 55],
[25, 24, 234, 386, 14, 30, 849, 7, 1914, 5, 26, 136, 278],
[131, 145, 48, 152, 101, 3, 63, 186, 13, 731, 1915, 5, 26, 136, 278],
[239, 255, 351, 244, 7, 70, 304, 5, 165, 42, 1916, 500, 3],
[191, 18, 570, 625, 21, 6, 33, 412, 418, 16, 14, 501, 203, 2, 243],
[8, 413, 9, 4, 142, 11, 9, 6, 30, 346, 1041, 21, 97, 2, 213],
[1917, 1343, 52, 1344, 496, 11, 1918, 198, 187, 251, 9, 3, 10],
[13, 81, 43, 9, 352, 70, 325, 562, 15, 117, 846, 2, 450, 4, 43, 9],
[352, 70, 325, 1042, 15, 117, 1919, 203, 2, 159, 29, 406, 77, 187],
[116, 69, 2, 265, 4, 15, 85, 850, 97, 732, 3],
[8, 1920, 6, 33, 262, 4, 10, 305, 5, 55, 840, 77, 97],
[77, 3, 1043, 18, 226, 21, 2, 488, 7, 18, 104, 5, 482, 97, 77, 9, 14],
[387, 4, 8, 14, 84, 571, 5, 215, 16, 8, 1044, 2, 195],
[324, 5, 26, 229, 24, 569, 732, 61, 42, 1921, 1041, 31, 13],
[23, 115, 29, 94, 69, 2, 77, 7, 1045, 155, 31, 36, 7, 2, 77],
[143, 5, 486, 16, 9, 177, 84, 1046, 4, 1007, 25, 326, 5, 107, 21],
[11, 2, 1922, 77],
[29, 8, 209, 5, 93, 4, 30, 191, 348, 72, 2, 1041],
[388, 1923, 2, 389, 7, 385],
[1924, 4, 1925, 3, 228, 13, 8, 14, 29, 94, 571, 16],
[25, 2, 164, 8, 84, 1362, 92, 5, 327, 179, 636, 409, 130],
[1047, 36, 50, 2, 1926, 1028, 16, 214, 14, 179, 1363, 231, 3],
[25, 61, 8, 113, 40, 20, 18, 231, 35, 177, 5, 26, 480, 36, 7],
[410, 35, 52, 205, 29, 328, 72, 197, 82, 186, 33, 231, 15, 238],
[79, 126, 153, 21, 67, 572, 4, 1927, 25, 12, 101, 1048, 130, 229],
[15, 733, 26, 1928, 15, 189, 26, 6, 129, 353, 185, 328, 72, 5, 623],
[573, 41, 12, 12, 89, 555, 2, 349, 77, 12, 117, 31, 15, 89, 26],
[502, 5, 46, 3, 63, 13, 637, 301, 35, 201, 713, 2, 77, 15, 454],
[5, 107, 299, 70, 66, 187, 314, 46, 6, 628, 734, 7, 1049, 345, 1929, 3],
[4, 8, 53, 21, 1930, 5, 55, 92, 8, 59, 555, 9, 420, 89],
[107, 60, 2, 1931, 3, 8, 63, 81, 92, 1016, 553, 491, 1050],
[1364, 5, 1932, 405, 231, 4, 92, 1933, 2, 1051, 126, 172],
[273, 137, 421, 1934],
[276, 2, 1936],
[19, 273, 1052],
[206, 171, 38, 638, 130, 261, 3],
[103, 57, 18, 104, 1365, 419, 2, 631, 7, 2, 449, 11, 497, 8, 14],
[101, 102, 192, 851, 231, 264, 4, 8, 20, 149, 194, 39, 2, 33, 560],
[450, 4, 373, 72, 5, 2, 265, 159],
[186, 13, 9, 14, 17, 94, 17, 8, 58, 45, 501, 40, 21, 42, 253, 5],
[172, 260, 69, 2, 265, 19, 42, 570, 31, 5, 116, 260, 14, 102],
[1937, 192, 214, 8, 254, 40, 4, 78, 5, 1053, 54],
[127, 296, 5, 26, 1366, 7, 422, 3, 10, 13, 390, 129, 829, 50],
[12, 3, 8, 174, 122, 95, 24, 731, 107, 21, 1358, 11, 24, 77, 639, 24],
[164, 15, 167, 12, 3, 31, 8, 53, 21, 22, 2, 195, 1938, 1939, 7],
[385, 852, 64, 14, 6, 141, 389, 22, 121, 18, 41, 489, 633],
[550, 4, 1367, 200, 40, 2, 449],
[120, 6, 65, 8, 161, 6, 33, 1054, 7, 231, 11, 2, 490, 4],
[8, 267, 1940, 18, 163, 5, 66, 38, 14, 443, 9, 14, 2, 157],
[112, 1941, 1942, 1943, 19, 6, 734, 7, 157, 735, 391, 11],
[42, 226, 4, 6, 141, 423, 11, 2, 90, 37, 125, 1368, 634, 11, 6, 129],
[382, 1055, 5, 640, 17, 37, 125, 197, 2, 132, 2, 132],
[206, 201, 8, 26, 853, 43, 224, 329, 18, 452, 3, 13, 199, 29],
[1944, 16, 8, 14, 503, 5, 377, 392, 7, 62, 42, 29, 61, 2, 112],
[125, 276, 18, 8, 78, 11, 6, 281, 1056, 109, 217, 12, 242, 641, 3],
[2, 112, 1311, 854, 736, 2, 157, 735, 391, 4, 2, 423],
[4, 1945, 170, 69, 2, 1946, 17, 504, 17, 37, 58, 107],
[13, 194, 39, 2, 423, 4, 391, 4, 17, 2, 449, 14, 30, 547, 8],
[329, 1947, 55, 22, 2, 65, 8, 53, 21, 261, 1948, 171, 92],
[354, 355, 32, 5, 162, 4, 1057, 143, 53, 21, 103, 17, 737],
[15, 238, 43, 224, 134, 505, 11, 2, 715, 299, 70, 91, 14, 15, 2],
[195, 61, 15, 115, 39, 24, 738, 15, 480, 91, 15, 117, 302, 566, 6],
[33, 424, 31, 43, 130, 27, 2, 195, 2, 158, 252, 32, 79],
[11, 2, 549, 286, 15, 1949, 241, 2, 129, 1950, 3, 4, 8, 78, 425],
[123, 22, 2, 417, 8, 282, 16, 52, 7, 2, 195, 855, 17, 55, 5],
[66, 43, 8, 58, 56, 134, 505, 25, 62, 7, 46],
[230, 229, 130, 27, 1951, 3, 8, 10, 567, 18, 574, 575, 11, 110, 144],
[1369, 4, 455, 268, 107, 11, 1369, 20, 22, 4, 130, 229, 15, 181],
[26, 856, 25, 15, 47, 22, 1058, 7, 143, 4, 8, 206, 8, 1370, 110, 6],
[30, 33, 1059, 857, 8, 4, 130, 15, 4, 206, 171, 92, 858],
[9, 22, 32, 187, 356, 43, 15, 47, 22, 2, 143, 15, 269, 5, 47, 299, 70],
[66, 489, 642, 506, 32, 859, 4, 489, 642, 1371, 32, 1952, 4],
[489, 642, 739, 32, 206, 171, 15, 189, 114, 116, 5, 1372, 20, 16, 451],
[227, 2, 1953, 243, 268, 1954, 1060, 356, 1955],
[1956, 32, 2, 860, 7, 1373, 4, 1373, 32, 2, 860, 7, 1374, 4],
[1374, 48, 241, 22, 740, 130, 726, 15, 89, 56, 134, 505, 25],
[856, 187, 356, 4, 95, 92, 1061, 2, 33, 3, 4, 8, 1062, 18],
[357, 21, 18, 1375, 17, 43, 8, 52, 280, 407, 4, 78, 5, 643, 9],
[31, 18, 109, 741, 1063, 4, 742, 4, 2, 213, 75, 27, 150, 2],
[195, 17, 35, 269, 5, 45],
[270, 1061, 2, 33, 1957],
[1958, 44, 1959, 456],
[4, 1960, 2, 1961, 7, 2, 1962],
[21, 345, 560, 1963],
[270, 1964, 37, 743, 5, 644],
[92, 1376, 861, 44, 1377],
[4, 1965, 33, 1966, 11],
[19, 1064, 1378, 1379, 3],
[230, 229, 381, 71, 27, 2, 137, 213, 3, 10, 186, 13, 4, 18, 163],
[1009, 19, 385, 54, 17, 8, 53, 21, 34, 89, 26, 856, 120, 22, 4],
[15, 189, 56, 5, 107, 4, 507, 11, 16, 1967, 33, 240, 4, 56, 158, 5],
[48, 1968, 5, 508, 19, 4, 206, 214, 29, 298, 407, 5, 509, 48, 224],
[156, 39, 82, 371, 41, 9, 43, 130, 856, 187, 744, 40, 106, 553, 26, 48],
[152, 98, 1065, 98, 408, 40, 4, 280, 150, 39, 54, 171, 15],
[189, 108, 172, 39, 4, 95, 79, 286, 15, 57, 167, 70, 16, 99, 4, 57],
[43, 15, 50, 235, 16, 500, 187, 150, 39, 43, 27, 187, 744, 40, 106],
[236, 130, 626, 379, 31, 206, 171, 3, 228, 13, 19, 6, 745, 1969],
[7, 385, 34, 45, 208, 35, 59, 153, 98, 408, 40, 15, 286, 29, 30, 546],
[7, 235, 22, 746, 106, 3],
[17, 8, 10, 24, 8, 113, 40, 20, 18, 357, 4, 14, 571, 5, 66],
[16, 8, 23, 153, 21, 42, 7, 2, 862, 33, 157, 735, 391, 188],
[8, 14, 261, 270, 117, 15, 56, 287, 16, 3, 8, 63, 34, 89],
[26, 387, 346, 54, 3, 8, 115, 39, 4, 53, 5, 2, 243, 5, 1970],
[55, 60, 9, 4, 142, 16, 17, 358, 17, 8, 58, 1066, 8, 14, 101],
[41, 136, 231, 264, 4, 14, 178, 21, 863, 1380, 8, 191, 142],
[36, 16, 2, 747, 7, 24, 14, 2, 423, 8, 14, 1043, 4, 8, 736],
[9, 267, 103, 11, 65, 5, 1971, 863, 170, 729],
[288, 14, 6, 1381, 864, 3, 10, 13, 6, 179, 353, 576, 20, 2],
[745, 306, 31, 30, 375, 5, 215, 55, 317, 11, 1972, 81],
[101, 25, 2, 265, 3, 4, 8, 259, 19, 22, 1973, 135, 5, 2, 33, 159],
[31, 837, 2, 33, 159, 14, 720, 54, 4, 2, 33, 560, 450, 14],
[501, 21, 2, 412, 243, 17, 124, 81, 143, 71, 1067, 192, 214, 3],
[63, 2, 186, 386, 567, 15, 114, 14, 29, 346, 17, 24, 124, 114],
[4, 15, 1382, 145, 185, 1383, 16, 9, 32, 3],
[17, 8, 10, 256, 213, 18, 421, 1068, 4, 11, 207, 164, 1974],
[8, 14, 39, 5, 18, 577, 11, 1069, 748, 18, 99, 277, 14, 16, 8],
[23, 1975, 826, 69, 2, 307, 81, 11, 16, 749, 15, 117, 107, 135, 60],
[1384, 3, 8, 10, 5, 55, 13, 23, 134, 5, 2, 1976, 149, 11],
[18, 326, 4, 23, 150, 5, 2, 645, 1385, 16, 1386, 12, 107],
[5, 21, 2, 636, 1977, 12, 215, 6, 510, 7, 1978, 1979, 11, 2],
[307, 96, 417, 1070, 11, 2, 1980, 19, 1981, 1982, 57, 6, 1332],
[7, 1983, 1984, 4, 319, 46, 6, 1384, 1985, 227, 8, 191],
[156, 36, 16, 8, 14, 11, 2, 389, 7, 385, 97, 8, 23, 1986, 61, 8],
[14, 851, 231, 264],
[34, 208, 15, 578, 228, 29, 94, 3, 10, 13, 17, 8, 750, 41, 303],
[5, 215, 18, 77, 36, 34, 189, 26, 1987, 25, 9, 101, 15, 359, 60],
[235, 1988, 11, 82, 405, 385, 16, 126, 26, 6, 354, 105, 5, 26, 229],
[227, 355, 32, 354, 5, 162, 3],
[103, 57, 8, 161, 245, 1387, 41, 11, 2, 389, 6, 33, 77],
[72, 4, 8, 750, 751, 5, 165, 36, 38, 9, 14, 20, 99, 8, 63],
[9, 89, 26, 6, 1989, 28, 1990, 31, 57, 8, 730, 92, 346],
[8, 14, 101, 4, 8, 191, 156, 36, 16, 9, 14, 108, 6, 119, 16, 23],
[1068, 11, 50, 55],
[752, 9, 26, 7, 62, 152, 101, 3, 63, 13, 731, 327, 5, 24, 119],
[355, 32, 29, 36, 7, 2, 77, 40, 106, 16, 15, 166, 91, 30],
[710, 9, 117, 308, 20, 62, 451, 255, 48, 1991, 11, 303, 3, 29, 8],
[78, 1992, 119, 45, 12, 47, 2, 77, 36, 7, 24, 389, 15, 286, 30, 546],
[7, 1388, 41, 106, 1389, 119, 3, 13, 63, 24, 89, 26, 2, 137],
[77, 7, 753, 5, 6, 119, 8, 23, 114, 287, 110, 6, 105, 124, 31],
[8, 730, 404, 275, 11, 18, 1993, 1994, 1995, 390, 119, 7],
[6, 119, 5, 6, 119, 6, 119, 1389, 119, 3, 2, 119, 113, 20, 18, 190],
[1996, 4, 177, 5, 18, 5, 1390, 19, 42, 7, 73, 33, 163],
[31, 9, 10, 155],
[1071, 9, 268, 579, 636, 3, 63, 13, 34, 1997, 145],
[6, 865, 119, 150, 123, 19, 580, 2, 1391, 3, 25, 19, 22],
[18, 1014, 7, 581, 13, 23, 48, 30, 1392, 1072, 92, 144, 1393],
[211, 23, 563, 29, 8, 78, 54, 1998, 1999, 1394, 2000, 3, 97],
[14, 2, 99, 582, 11, 18, 865, 1073, 370, 2, 119, 285, 6],
[745, 2001, 36, 7, 2, 748, 4, 177, 5, 2002, 22, 123, 19, 1395],
[197, 15, 511, 67, 646, 3, 228, 13, 267, 344, 16, 8, 23, 1022],
[2, 186, 2003, 1396, 34, 84, 1362, 12, 300, 50, 318, 3],
[393, 50, 318, 3, 228, 2, 119, 11, 6, 754, 2004, 109, 752],
[12, 50, 318, 43, 12, 52, 70, 3],
[198, 301, 27, 3, 10, 13, 11, 6, 2005, 128, 647, 26, 755],
[41, 9, 4, 193, 15, 208, 15, 58, 1074, 12, 457, 138, 380, 15, 91, 512],
[222, 6, 554, 5, 318, 43, 12, 58, 108, 66, 18, 8, 32, 110, 6, 171, 1397],
[105, 3, 13, 53, 21, 200, 5, 55, 17, 8, 750, 2006, 41, 11, 2],
[389, 81, 8, 2007, 1398, 29, 1399, 60, 2, 866, 2008, 18, 867, 4],
[1075, 18, 283, 4, 8, 32, 110, 6, 627, 2009, 105, 5, 1076, 4, 857],
[110, 6, 860, 42, 25, 1400, 832, 206, 15, 511, 67, 646, 3, 228],
[13, 54, 25, 24, 65, 2, 119, 14, 2010, 22, 123, 4, 8],
[199, 726, 9, 89, 26, 415, 426, 394, 201, 308, 41, 18, 62],
[102, 43, 512, 190, 27, 3],
[394, 266, 3, 228, 2, 119, 79, 14, 648, 40, 5, 2, 223, 7, 44],
[456, 513, 43, 15, 59, 308, 21, 110, 6, 583, 457, 2011, 330, 2012],
[318, 2013, 281, 2014, 143, 85, 299, 70, 294, 2, 378, 54, 3],
[34, 201, 266, 3, 10, 13, 11, 6, 129, 382, 5, 306, 2, 583, 7],
[458, 584, 12, 71, 12, 849, 7, 7, 1077, 3, 2, 119, 75, 27],
[447, 29, 13, 53, 21, 514, 868, 32, 110, 6, 627, 33, 1401, 276],
[457, 240, 15, 166, 50, 5, 1074, 12, 6, 33, 495, 2015, 2016, 12],
[47, 19, 206, 110, 144, 2017, 1402, 574, 4, 553, 756, 143, 61],
[12, 1078, 46, 4, 553, 649, 39, 4, 511, 25, 73, 1403, 4, 22, 1058],
[7, 143, 15, 181, 302, 200, 7, 46, 4, 9, 1404, 5, 6, 2018],
[12, 47, 4, 37, 869, 145, 29, 1405, 145, 818, 6, 2019, 2020, 37],
[869, 9, 2021, 22, 2, 2022, 4, 206, 171, 3, 228, 13, 11, 6, 1406],
[128, 230, 344, 224, 426, 9, 54, 3, 25, 2, 119, 14, 1388],
[170, 100, 18, 17, 504, 17, 9, 58, 107, 4, 483, 84, 6, 2023, 11],
[2, 389, 17, 9, 53],
[29, 8, 289, 2024, 120, 9, 2025, 171, 45, 150, 135, 54, 4, 175],
[201, 308, 41, 318, 28, 1077, 406, 43, 12, 85, 50, 46, 3, 61, 2],
[119, 161, 24, 9, 263, 121, 4, 750, 485, 135, 5, 18, 73],
[283, 14, 84, 870, 19, 1079, 13, 63, 4, 9, 10, 11, 6, 281],
[648, 109, 1080, 290, 116, 5, 2, 871, 4, 57, 187, 167, 12, 82],
[581, 4, 872, 579, 239, 9, 32, 15, 1407, 318, 4, 1077, 3],
[9, 14, 264, 65, 5, 107, 25, 2, 389, 14, 205, 84, 757, 19, 2],
[427, 4, 873, 16, 23, 826, 69, 9, 64, 52, 6, 874, 4, 6, 331],
[6, 585, 4, 76, 1081, 4, 712, 90, 234, 459, 13, 838, 2],
[77, 4, 2, 332, 395, 750, 5, 2, 871],
[388, 2026, 6, 1082, 650, 4, 6, 144, 875],
[35, 52, 266, 6, 354, 151, 395, 16, 1408, 21, 2, 1004, 2],
[427, 19, 2027, 2028, 2, 873, 19, 98, 1083, 2029, 316],
[5, 46, 4, 22, 2030, 1409, 1084, 4, 876],
[2, 99, 252, 7, 182, 14, 92, 5, 116, 493, 54, 35, 23, 6],
[2031, 41, 24, 4, 120, 6, 414, 384, 9, 177, 84, 819],
[5, 13, 5, 215, 55, 261, 2032, 19, 46, 17, 43, 8, 23],
[2033, 46, 22, 18, 326, 266, 8, 23, 84, 6, 144, 877, 19, 2],
[585, 79, 20, 147, 263, 1085, 4, 59, 108, 95, 34, 286, 1410, 192],
[12, 4, 89, 47, 2034, 4, 24, 13, 59, 27, 1086, 146],
[1411, 92, 218, 9, 14, 4, 17, 2, 585, 2035, 2036, 5, 167, 73],
[855, 64, 14, 48, 102, 5, 26, 10],
[20, 147, 2, 119, 79, 177, 5, 26, 6, 500, 7, 1412, 343, 46],
[289, 36, 1413, 40, 22, 7, 12, 4, 552, 5, 70, 187, 191, 165, 12],
[493, 244, 3, 35, 22, 254, 40, 20, 149, 11, 6, 141, 1414, 19, 2, 119],
[11, 2, 494, 13, 329, 18, 163, 305, 2037, 21, 9, 25, 8, 199],
[229, 8, 59, 1020, 6, 1383, 2038, 43, 8, 75, 27, 116, 493, 30, 191],
[2039, 3, 10, 2, 119, 19, 76, 651, 279, 584, 12, 22, 503, 24],
[32, 2, 2040, 105, 15, 47, 360, 22, 121, 43, 12, 242, 580],
[2, 1391, 1415, 747, 14, 2041, 60, 2, 2042, 14, 191, 2043],
[5, 60, 2, 636, 79, 878, 2044, 4, 23, 134, 7, 624, 94],
[2045, 5, 2046, 4, 2047, 1416, 4, 1417, 2, 1418, 7],
[1419, 4, 1420, 3],
[2048, 3, 10, 2, 585, 19, 6, 2049],
[34, 511, 67, 646, 3, 10, 2, 119, 879, 31, 30, 652, 1087],
[12, 327, 3],
[393, 15, 3, 10, 2, 585, 267],
[34, 63, 12, 75, 3, 10, 2, 119, 3, 15, 1421, 1416, 4, 1417],
[2, 1418, 7, 1419, 4, 1420, 2050, 25, 118, 4, 212, 2051],
[2, 2052, 1422, 7, 2053, 142, 9, 1423, 3],
[1424, 38, 3, 10, 2, 874],
[1424, 9, 3, 2, 119, 168, 190, 2054, 361, 182, 12, 47, 38],
[9, 515, 3],
[34, 47, 38, 9, 515, 122, 244, 61, 15, 215, 6, 105, 3, 10, 2],
[874, 196, 569, 6, 1088, 28, 6, 2055, 2, 252, 32, 38, 75, 2],
[1422, 215, 3],
[2, 119, 75, 27, 516, 24, 252, 31, 1425, 53, 21, 3, 142],
[9, 1423, 5, 107, 19, 2056, 2057, 5, 1089, 580, 4, 1426, 118, 2],
[1090, 2058, 2059, 20, 99, 14, 2060, 31, 2, 2061, 7, 44],
[2062, 92, 71, 12, 205, 21, 101, 82, 171, 3, 9, 460, 362],
[5, 13, 17, 9, 249],
[513, 1409, 17, 214, 3, 10, 13, 11, 6, 653, 128, 160, 268, 491, 5],
[493, 70, 20, 22, 3],
[498, 16, 749, 3, 10, 2, 331, 880, 2063, 5, 73, 231, 34, 1091],
[16, 2, 2064, 2065, 25, 2, 1092, 2066, 7, 102, 2067],
[1428, 636, 3, 10, 2, 1081, 34, 85, 47, 2, 517, 7, 200],
[381, 144, 213, 4, 1429, 102, 15, 85, 461, 12, 45, 406, 3, 4],
[2, 1081, 2068, 40, 73, 104, 5, 2069, 6, 1430, 96, 7, 2, 90, 427],
[139, 15, 14, 178, 5, 95, 3, 10, 2, 331, 11, 76, 426, 128, 2072, 16],
[2, 349, 105, 5, 116, 290, 493, 59, 26, 6, 1082, 650, 3],
[139, 32, 6, 1082, 650, 3, 10, 13, 27, 16, 8, 878, 94, 5, 47],
[31, 2, 331, 23, 2073, 17, 43, 9, 63, 16, 626, 296, 5, 327],
[4, 48, 42, 379, 177, 2074, 5, 95, 211],
[210, 3, 10, 2, 331, 219, 349, 77, 5, 518, 9, 32, 5, 45, 9, 3, 4, 17],
[12, 174, 50, 5, 356, 2, 105, 422, 96, 2075, 162, 15, 126, 167],
[12, 92, 2, 331, 823, 9],
[99, 9, 496, 36, 6, 650, 182, 11, 6, 225, 7, 2076, 219, 2077],
[2078, 268, 448, 3, 9, 10, 4, 57, 22, 2, 395, 52, 2079],
[634, 2, 182, 106, 4, 64, 64, 14, 48, 758, 136, 180, 4],
[170, 3, 31, 35, 78, 519, 61, 35, 654, 4, 304, 72, 61, 35],
[654, 29, 16, 9, 14, 27, 1093, 5, 47, 61, 2, 650, 14, 123, 227],
[61, 35, 23, 134, 519, 200, 76, 1431, 28, 29, 4, 52, 84, 493, 54],
[2, 331, 315, 289, 36, 219, 650, 32, 123, 3, 4, 35, 22, 757],
[121, 9, 1432, 4, 714, 131, 79, 520, 1433, 3],
[24, 252, 2, 331, 58, 27, 447, 146, 6, 129, 353, 7, 63],
[4, 9, 254, 25, 6, 144, 65, 19, 42, 725, 1094, 173, 73, 1434],
[2, 1435, 11, 97, 12, 1351, 66, 2080, 11, 2, 817],
[7, 118, 188, 2, 428, 383, 11, 360, 20, 147, 2, 331, 10],
[1436, 520, 1433, 4, 22, 89, 56, 881, 3],
[131, 79, 32, 5, 314, 2, 881, 3, 84, 6, 759, 7, 1095, 257],
[210, 8, 7, 182, 3, 10, 2, 331, 882, 5, 13, 19, 42, 725],
[4, 2, 332, 395, 20, 149, 757, 121, 18, 2081, 36, 11, 6, 883],
[77, 2082, 881, 3],
[13, 23, 48, 277, 38, 5, 45, 4, 11, 2083, 8, 153, 18, 226, 11, 18],
[548, 4, 2084, 36, 6, 418, 7, 1437, 1438, 2, 1069, 748, 23],
[27, 115, 69, 9, 4, 1096, 46, 121, 17, 881, 64, 14, 655, 42],
[6, 656, 22, 121],
[131, 8, 89, 56, 6, 2085, 55, 12, 47, 3, 10, 2, 119],
[361, 182, 3, 2, 331, 168, 30, 1097, 139, 379, 56, 12, 115, 11],
[67, 548, 3, 37, 53, 21, 362, 5, 13],
[884, 6, 1098, 3, 10, 13, 719],
[2086, 9, 123, 106, 3, 10, 2, 331],
[57, 35, 22, 757, 121, 18, 149, 102, 188, 2, 331, 880],
[2087, 2, 1098, 280, 394, 511, 67, 2088, 7, 24, 2089],
[2090, 4, 61, 9, 23, 348, 24, 885, 1099, 35, 22, 1100],
[13, 63, 2, 332, 105, 30, 1439, 31, 35, 22, 113, 29, 1101],
[16, 8, 75, 27, 760, 5, 2091, 4, 17, 8, 58, 27, 91, 7, 211],
[5, 95, 8, 1102, 886, 4, 194, 2, 1098, 151, 17, 1103, 17, 8],
[2, 158, 105, 14, 5, 251, 2, 1437, 24, 1440, 96, 1104, 4],
[761, 17, 2, 141, 427, 2092, 16, 35, 58, 27, 1354],
[2093, 4, 2, 346, 2094, 1105, 4, 23, 5, 26, 2095, 21, 2, 135],
[227, 9, 14, 123, 20, 147, 4, 35, 254, 40, 54, 11, 6, 1414, 4],
[2096, 2, 119, 5, 167, 46, 245, 102],
[127, 2097, 5, 167, 70, 67, 581, 12, 47, 3, 10, 13, 81, 239],
[9, 32, 12, 1407, 657, 4, 1441, 3, 8, 202, 11, 6, 1106, 200, 344, 16, 9],
[59, 26, 426, 54],
[2098, 32, 6, 144, 4, 6, 1107, 875, 3, 10, 2, 119, 362, 5, 13, 4],
[160, 32, 6, 144, 456, 320, 3, 10, 13, 151, 40, 19, 238, 20],
[2, 2099, 456, 131, 239, 45, 12, 762, 9, 1107, 3, 4, 8, 329, 21, 858],
[41, 9, 188, 2, 119, 14, 753, 29, 16, 18, 277, 7, 2, 875, 14],
[245, 50, 24],
[2100, 10, 5, 6],
[119, 16, 37],
[887, 11, 2],
[271, 107, 5],
[888, 15, 126],
[187, 222, 48],
[89, 56, 6],
[119, 5, 2],
[127, 71, 27, 1109, 3, 10, 2, 119, 5, 13, 848, 139, 71, 12],
[425, 7, 3],
[34, 511, 67, 646, 3, 10, 13, 30, 1444, 127, 23, 115, 5, 2, 2107],
[1445, 15, 91, 3],
[34, 23, 27, 3, 228, 2, 119, 847, 4, 30, 462],
[390, 1446, 3, 10, 13, 330, 503, 5, 165, 55, 1405, 4, 151],
[305, 41, 18, 197, 45, 299, 70, 392, 5, 2108, 9, 3],
[34, 189, 45, 155, 7, 2, 225, 3, 10, 2, 119, 205, 39, 4, 717],
[170, 127, 2109, 70, 60, 261, 110, 638, 3],
[34, 300, 429, 9, 3, 1110, 186, 13, 131, 250, 29, 891, 426],
[12, 47, 3],
[2, 119, 108, 2110, 11, 763],
[892, 150, 135, 4, 764, 67, 521, 3, 13, 289, 120, 9, 4, 2],
[522, 22, 1111, 11, 759, 363, 242, 45, 3, 31, 2, 119, 108, 463],
[73, 104, 765, 4, 411, 6, 33, 2111],
[139, 6, 1112, 9, 342, 744, 3, 766, 2, 585, 17, 191, 17, 9, 14, 84],
[36, 7, 410, 4, 76, 218, 1113, 194, 2, 444, 7, 280, 5, 18],
[2112, 893, 82, 171, 299, 24, 26, 6, 1073, 5, 12, 114, 5, 2113],
[67, 767, 3, 894, 67, 895, 1394, 3, 10, 2, 768, 1113, 6, 33],
[2114, 658, 244, 5, 356, 2, 2115, 7, 76, 2116, 3],
[34, 208, 15, 23, 457, 380, 106, 15, 47, 15, 45, 3, 10, 13, 711, 2117],
[659, 11, 660, 2118, 191, 756, 9, 135, 3],
[81, 79, 32, 380, 43, 15, 174, 1114, 5, 377, 2, 252, 3, 10, 2],
[13, 168, 514, 25, 8, 14, 330, 503, 5, 308, 41, 18, 2119],
[2120, 457, 138, 4, 857, 110, 6, 860, 42, 25, 1400, 832, 12],
[181, 91, 4, 206, 15, 208, 12, 58, 66, 18, 120, 2, 427, 239],
[1019, 251, 6, 33, 1447, 17, 191, 17, 172, 20, 9, 3],
[24, 1099, 1440, 6, 1306, 1448, 343, 2, 395, 96, 7, 2],
[427, 373, 72, 20, 149, 42, 218, 2121, 78, 2122, 295, 39, 30],
[1115, 1116, 34, 415, 89, 26, 205, 709, 2, 715, 279],
[268, 1117, 82, 1449, 3, 4, 6, 2123, 289, 36, 11, 6, 648, 109, 5],
[73, 417, 284, 170, 82, 1048, 145, 264, 65, 12, 52, 22, 11, 2124, 3],
[21, 1450, 2125, 35, 22, 769, 72, 4, 13, 14, 191, 304, 746],
[34, 208, 15, 578, 1118, 380, 3, 8, 10, 5, 55, 11, 6, 653],
[128, 1451, 743, 5, 50, 18, 40, 106, 4, 130, 229, 857, 2, 349],
[138, 11, 2, 549, 206, 82, 171, 380, 15, 238, 43, 15, 189, 214, 66, 12],
[62, 102, 3, 4, 106, 186, 13, 78, 5, 1053, 54, 25, 8, 199, 30],
[1452, 4, 281, 2126, 11, 6, 33, 188, 227, 8, 54, 161],
[6, 33, 1054, 7, 1453, 11, 2, 490, 4, 8, 113, 39],
[514, 200, 1030, 16, 2, 119, 23, 505, 44, 371, 4, 14, 443],
[135, 5, 764, 44, 521],
[388, 2127, 2, 112, 2128, 11, 6, 33, 333],
[9, 14, 2, 157, 112, 1368, 485, 135, 54, 4, 151],
[305, 41, 17, 9, 53, 17, 43, 9, 23, 1023, 245, 4, 8, 161],
[9, 1055, 5, 295, 219, 132, 2, 132, 206, 82, 171, 867, 206],
[82, 1083, 4, 1024, 1019, 116, 70, 661, 17, 229, 17, 1454, 71],
[1454, 291, 117, 15, 56, 736, 46, 15, 238, 3, 13, 1119, 11, 6],
[164, 16, 9, 14, 151, 25, 2, 423, 4, 2, 734, 7, 157, 735, 391],
[4, 8, 30, 179, 2129, 78, 1120, 41, 25, 46, 31, 35, 52],
[1455, 5, 26, 275, 355, 177, 5, 56, 505, 896, 18, 897, 11],
[2, 389, 4, 2, 129, 449, 19, 2, 412, 243, 4, 2, 33, 159],
[23, 898, 2130],
[30, 191, 2, 112, 487, 13, 17, 8, 53, 1120, 41, 4],
[289, 36, 5, 18, 11, 76, 755, 128, 210, 1121, 899, 38, 71, 12, 770],
[36, 106, 900, 709, 24, 164, 4, 756, 70, 6, 734, 7, 391, 4, 6, 423],
[1456, 101, 3, 4, 13, 14, 29, 94, 576, 16, 8, 259, 72, 20, 149],
[11, 2, 771, 9, 2131, 5, 146, 303, 5, 518, 2, 1122, 9],
[587, 194, 70, 25, 44, 2132, 3, 8, 10, 5, 55, 17, 8, 259, 270],
[571, 2133, 26, 61, 37, 2134, 36, 79, 15, 286, 31, 588, 334, 222, 118],
[44, 423, 4, 391, 16, 32, 43, 15, 117, 215, 46, 3, 17, 8, 10, 24, 8],
[125, 173, 6, 2135, 33, 240, 21, 2, 159, 7, 97, 14, 6, 495, 2136],
[1123, 19, 2, 378, 2137, 2138, 2139, 173, 9, 8, 53, 11, 146],
[1124, 4, 373, 2140, 11, 129, 822, 2141, 8, 166, 1089, 2],
[1125, 1121, 899, 4, 26, 263, 36, 7, 2, 240, 124, 8, 23, 142, 2],
[423, 4, 391],
[270, 354, 9, 743, 3, 13, 10, 5, 55, 731, 26, 178, 1457, 25],
[6, 112, 15, 359, 2142, 26, 1050, 70, 21, 1457, 158, 3, 4, 8],
[78, 2143, 2, 225, 7, 105, 16, 59, 486, 3, 830, 13, 150],
[106, 1126, 4, 116, 503, 25, 67, 713, 443, 11, 6, 216],
[1076, 31, 224, 115, 5, 66, 16, 2, 119, 268, 116, 36, 108, 15, 85],
[91, 3, 13, 53, 21, 288, 1127, 299, 380, 639, 11, 2, 240, 43, 9],
[78, 1458, 278, 41, 50, 16, 3],
[60, 24, 65, 8, 23, 142, 18, 77, 69, 6, 2144, 33, 335, 19, 6, 243],
[11, 2, 523, 4, 21, 9, 17, 8, 23, 2145, 6, 423, 4, 136, 28, 180, 2146],
[7, 836, 157, 735, 391, 8, 194, 39, 2, 423, 4, 6, 734, 7, 2, 391],
[4, 14, 103, 178, 5, 568, 2, 335, 61, 18, 570, 625, 173, 6, 33],
[416, 16, 589, 276, 2, 151, 412, 64, 14, 48, 1342, 24, 65],
[19, 2, 213, 1031, 70, 3, 31, 2147, 8, 2148, 9, 4, 153, 9],
[5, 18, 2149, 34, 47, 245, 772, 32, 229, 5, 486, 3, 8, 10],
[5, 55, 2150, 15, 251, 28, 843, 211, 29, 187, 103, 66, 38],
[24, 416, 464, 15, 45, 831, 553, 165, 70, 325, 141, 54, 25, 415],
[130, 84, 546, 7, 235, 110, 6, 836, 33, 105, 3],
[9, 75, 29, 266, 4, 94, 1353, 192, 8, 23, 2151, 124, 8, 23],
[1459, 200, 2, 416, 8, 142, 18, 104, 2152, 419, 2, 2153],
[4, 23, 5, 1460, 5, 2154, 18, 564, 100, 235, 662, 8, 267, 153],
[40, 2, 416, 280, 5, 55, 272, 84, 244, 15, 831, 15, 733],
[325, 62, 102, 17, 9, 32, 15, 181, 116, 36, 20, 2, 159, 15, 45, 208, 15, 578],
[1459, 84, 29, 94, 3],
[837, 9, 14, 185, 624, 5, 208, 16, 8, 53, 21, 387, 4, 387],
[4, 30, 191, 23, 5, 2155, 40, 21, 2, 1128, 11, 207, 216, 64],
[14, 27, 212, 335, 25, 24, 4, 8, 232, 2, 1129, 7, 501, 40, 19],
[42, 1130, 419, 2, 159, 4, 2, 90, 292, 1461, 121, 18, 104],
[317, 8, 53, 21, 387, 4, 17, 6, 147, 2156, 8, 153, 42, 292, 36],
[7, 2, 523, 4, 42, 421, 39, 2, 663, 4, 10, 5, 55, 409, 15],
[117, 45, 48, 102, 1131, 732, 38, 126, 773, 7, 70, 3],
[1438, 25, 13, 2, 33, 2157, 416, 23, 101, 23, 73, 237, 1129],
[4, 8, 2158, 48, 562, 317, 9, 14, 30, 876, 4, 17, 64],
[177, 5, 26, 48, 225, 7, 901, 7, 18, 214, 205, 36, 7, 2, 335],
[54, 48, 238, 8, 199, 1462],
[160, 14, 94, 2159, 20, 709, 3, 63, 186, 13, 774, 42, 396],
[330, 387, 562, 4, 1042, 4, 235, 1132, 41, 60, 832, 4],
[2160, 15, 480, 208, 15, 578, 336, 40, 16, 112, 820, 4, 193, 4],
[193, 145, 190, 234, 12, 47, 24, 225, 7, 326, 15, 45, 238, 38],
[117, 56, 563, 5, 70, 61, 15, 269, 5, 322, 2161, 2162, 15, 1463, 16],
[502, 7, 105, 114, 563, 4, 101, 106, 15, 286, 11, 2, 494, 7, 42],
[64, 296, 5, 26, 6, 370, 445, 41, 70, 16, 64, 296, 4, 61, 15],
[325, 39, 187, 775, 42, 31, 130, 590, 39, 101, 3, 8, 202, 11, 6, 1406],
[128, 1133, 465, 255, 48, 335, 5, 325, 39, 62, 102, 106, 3],
[131, 57, 3, 63, 13, 1464, 15, 114, 116, 62, 1410, 192, 15, 286],
[101, 2163, 26, 6, 2164, 42, 77, 114, 5, 26, 76, 218, 1465, 31],
[57, 330, 5, 56, 407, 5, 509, 206, 15, 776, 50, 16, 3],
[197, 12, 2165, 13, 3, 8, 902, 55, 270, 117, 12, 509],
[407, 11, 106, 239, 255, 351, 335, 25, 12, 4, 48, 335, 20, 22],
[25, 62, 1073, 1466, 3],
[4, 29, 8, 53, 21, 777, 99, 42, 253, 4, 57, 2, 90, 4, 483],
[84, 6, 458, 7, 9, 729, 31, 120, 6, 414, 384, 8, 161],
[6, 109, 591, 4, 1134, 5, 552],
[2166, 899, 1121, 899, 3, 10, 2, 109, 1467, 70, 82, 391, 24, 164, 3],
[57, 125, 6, 33, 1054, 7, 231, 21, 2, 1011, 13, 282, 9, 14],
[2, 112, 443, 5, 172, 25, 18, 4, 8, 1468, 236, 8, 463, 2],
[240, 84, 1135, 16, 8, 14, 101, 41, 6, 1322, 642, 17, 141],
[17, 2, 112, 4, 23, 48, 466, 5, 26, 344, 7, 9],
[1327, 2, 112, 125, 39, 5, 2, 159, 4, 232, 5, 561, 9, 31, 17],
[2, 159, 413, 2167, 4, 273, 1130, 14, 1094, 504, 419, 9],
[16, 2168, 1469, 6, 2169, 13, 161, 9, 95, 5, 295, 364, 187],
[107, 121, 4, 116, 11, 20, 2, 523, 3],
[288, 12, 2170, 63, 13, 4, 120, 452, 236, 8, 1463],
[8, 161, 2, 112, 103, 203, 2, 523, 8, 315, 861, 36, 18],
[226, 4, 156, 6, 1470, 11, 2, 279, 8, 75, 27, 116, 565, 7, 211],
[31, 8, 161, 6, 33, 778, 4, 6, 551, 4, 6, 1136, 7, 662, 412],
[100, 97, 8, 1471, 16, 9, 14, 103, 2171, 9, 23, 826, 69, 6],
[1472, 2172, 28, 245, 7, 2, 225],
[158, 125, 76, 755, 109, 2, 862, 2173, 1473, 291, 71, 12, 3, 4],
[57, 6, 109, 8, 23, 114, 161, 124, 903, 57, 130, 106, 1070],
[25, 1474, 904, 905, 3],
[2174, 25, 1474, 266, 3, 10, 2, 112, 462, 1137, 150, 4],
[392, 70, 36, 7, 24, 3, 906, 7, 102, 662, 412],
[409, 167, 70, 1473, 1429, 16, 11, 2, 523, 3],
[903, 145, 76, 292, 904, 905, 3, 37, 2175, 9, 2176, 3],
[2177, 292, 12, 1475, 79, 214, 297, 42, 16, 324, 239, 9, 2178, 2, 332],
[903, 9, 464, 904, 905, 31, 145, 76, 292, 25, 22, 16, 3],
[198, 145, 115, 48, 467, 64, 20, 62, 451, 107, 4, 222, 9, 170, 3],
[64, 14, 6, 144, 360, 120, 24, 4, 13, 58, 108, 294, 2179],
[101, 4, 57, 110, 17, 903, 15, 85, 50, 9, 904, 905, 20, 22, 20],
[22, 3, 492, 17, 15, 167, 12, 12, 2180, 3, 4, 20, 147, 8, 861, 36, 18],
[226, 54, 4, 156, 207, 1470, 11, 2, 279, 24, 65, 64, 52],
[136, 33, 2181, 4, 102, 906, 7, 662, 412, 139, 6, 510, 7],
[1472, 2182, 64, 89, 26, 3, 63, 13, 34, 238, 38, 824, 45],
[158, 17, 25, 2183, 70, 36, 7, 2, 523, 15, 108, 208, 35, 58, 130],
[229, 15, 85, 454, 5, 744, 11, 106, 62, 1025, 3],
[8, 383, 25, 96, 65, 146, 907, 211, 102, 20, 147, 125, 6],
[2184, 7, 33, 2185, 4, 2, 828, 7, 6, 179, 298, 1095],
[22, 261, 468, 8, 156, 36, 2, 213, 2186, 2, 90],
[2187, 239, 15, 578, 5, 1360, 31, 42, 908, 115, 2, 90, 333],
[756, 9, 106, 2188, 106, 153, 1138, 39, 20, 24, 835, 48, 2189, 1138],
[468, 99, 35, 85, 846, 200, 264, 244, 193, 206, 824],
[45, 122, 244, 85, 26, 660, 106, 333, 1020, 565, 7, 24],
[2190, 126, 2, 631, 1476, 371, 16, 1477, 909, 206, 145, 443],
[40, 408, 664, 3, 6, 665, 1136, 409, 79, 75, 16, 9, 14, 333, 15],
[554, 2191, 5, 107, 40, 2, 663, 2192, 15, 733, 12, 45, 9, 16, 15],
[201, 57, 908, 5, 107, 40, 106, 333, 2, 910, 869, 250, 5],
[107, 40, 2, 663, 3],
[197, 29, 908, 115, 5, 150, 40, 2, 663, 520, 37, 3, 10, 13, 5],
[55, 2193, 35, 491, 5, 153, 355, 173, 333, 15, 342, 26, 11],
[908, 469, 25, 6, 179, 353, 24, 2194, 32, 1381, 5, 26, 229, 31],
[15, 91, 15, 117, 1139, 6, 33, 3],
[8, 779, 18, 421, 17, 328, 40, 2, 663, 17, 8, 58, 4, 383],
[236, 8, 161, 6, 33, 2195, 8, 446, 1066, 7, 38, 225, 9, 14],
[2196, 4, 2197, 41, 11, 2, 663, 316, 1140, 18, 57],
[280, 5, 55, 1141, 32, 333, 3, 8, 285, 42, 666, 1139, 4, 383, 5],
[66, 38, 59, 486, 158],
[2, 99, 105, 8, 161, 14, 6, 645, 759, 7, 868, 575, 333, 3],
[57, 2, 862, 109, 634, 2198, 118, 12, 60, 2, 1312, 3, 57],
[360, 4, 57, 207, 761, 7, 1095, 894, 39, 44, 104, 2199],
[101, 85, 2200, 118, 92, 14, 9, 218, 911, 38, 563, 5, 12, 167],
[290, 22, 41, 9, 3],
[147, 125, 6, 33, 1478, 1479, 109, 272, 333, 3, 63],
[13, 198, 15, 351, 47, 48, 102, 2201, 2202, 130, 334, 101, 31, 130],
[6, 353, 185, 2203, 5, 167, 12, 22, 15, 47, 32, 245, 1480, 20, 70],
[50, 6, 2204, 11, 2, 418, 4, 39, 15, 575, 50, 6, 780, 2205, 3],
[592, 12, 75, 218, 911, 3, 10, 2, 522],
[394, 89, 1350, 2, 240, 40, 3, 10, 2, 862, 109, 4, 13, 289],
[36, 17, 665, 17, 8, 58, 217, 12, 45, 187, 209, 380, 20, 12, 3],
[64, 14, 6, 912, 360, 781, 4, 13, 63, 5, 55, 34],
[238, 38, 35, 126, 45, 158, 43, 35, 23, 62, 1142, 1127, 222, 2],
[631, 72, 3, 120, 6, 216, 28, 136, 35, 78, 1143, 41, 54, 4],
[13, 161, 2, 112, 95, 390, 1481, 126, 45, 5, 347, 19, 3],
[390, 1481, 7, 38, 3, 63, 13, 31, 8, 23, 27, 144, 5, 913],
[25, 2, 158, 164, 6, 1482, 7, 33, 1483, 125, 1484, 11, 20, 2],
[523, 4, 96, 7, 46, 1485, 18, 11, 2, 283, 782, 153, 6, 639, 5, 24, 3],
[8, 10, 5, 55, 4, 470, 36, 1486, 334, 27, 45, 16, 54, 3],
[97, 1487, 207, 912, 360],
[13, 487, 19, 96, 783, 16, 2, 1483, 52, 22, 362, 69],
[33, 1144, 17, 35, 914, 21, 2, 1128, 4, 6, 495, 277, 125, 69, 18],
[104, 217, 15, 251, 42, 7, 256, 1144, 3, 8, 63, 196, 229, 5, 165],
[96, 306, 11, 82, 324, 4, 17, 9, 181, 1039, 165, 70, 562, 9, 89],
[165, 70, 1042, 15, 359, 3],
[29, 8, 2206, 42, 7, 2, 1144, 4, 14, 1488, 5, 215, 16, 8],
[78, 863, 1126, 17, 191, 17, 8, 14, 346, 244, 5, 116, 260],
[2, 159, 8, 259, 36, 7, 2, 240, 4, 142, 84, 6, 915, 7, 33],
[873, 4, 427, 452, 591, 2, 186, 33, 784, 333, 14],
[11, 2, 494, 235, 916, 39, 60, 136, 667, 668, 79, 52, 1489, 9],
[245, 36, 7, 6, 416, 35, 22, 156, 6, 1490, 20, 13, 2, 164, 8],
[524, 31, 8, 259, 72, 17, 504, 17, 8, 58, 4, 191, 142, 55],
[1491, 11, 6, 2207, 525],
[219, 99, 105, 224, 115, 5, 45, 3, 10, 13, 5, 55, 17, 8, 1492],
[41, 11, 2, 525, 917, 5, 325, 5, 82, 137, 324, 54, 4, 2, 632],
[105, 32, 5, 215, 82, 77, 69, 16, 1357, 265, 15, 91, 16, 126, 26],
[2, 349, 918, 3],
[9, 741, 76, 1493, 918, 48, 913, 4, 30, 1376, 4, 1102],
[2208, 2, 108, 919, 14, 16, 8, 23, 27, 2, 1494, 277],
[92, 5, 209, 41, 9, 4, 188, 8, 14, 2209, 41, 305, 343],
[2, 593, 6, 33, 666, 1495, 103, 123, 18, 104, 156, 18, 172, 39, 11, 6],
[76, 2210, 669, 14, 151, 40, 20, 18, 19, 141, 121, 163, 4],
[2211, 1496, 36, 42, 1145, 303, 5, 2212, 18, 2213, 33, 105, 3],
[10, 13, 11, 6, 1497, 128, 4, 8, 232, 504, 5, 2214, 5, 9, 31],
[8, 14, 2215, 576, 22, 2, 65, 20, 2, 63, 16, 9, 174, 26],
[1146, 11, 97, 749, 9, 59, 26, 30, 710, 5, 251, 18, 39, 11, 2216, 7],
[22, 18, 1497],
[351, 1411, 38, 8, 75, 8, 1147, 39, 6, 33, 262, 7, 920, 4],
[916, 9, 36, 5, 2, 669, 2217, 2, 669, 630, 69, 2, 279, 72],
[22, 73, 231, 20, 149, 19, 6, 2218, 7, 1027, 4, 2219, 20, 2, 920],
[4, 156, 461, 5, 2220, 9, 57, 13, 2221, 319, 6, 129, 1498],
[5, 365, 55, 100, 235, 900, 123, 4, 2, 164, 8, 524, 21, 2],
[90, 253, 2, 669, 156, 207, 1490, 20, 2, 920, 4, 2222, 104],
[123, 2223, 11, 73, 382, 5, 116, 565, 7, 9, 57, 13, 425, 9, 14],
[30, 50, 404, 6, 350, 7, 508, 19, 6, 2224, 2225, 4, 1045, 345],
[164, 5, 26, 2226, 203, 73, 231, 259, 121, 2, 1498, 54, 57],
[2, 669, 78, 6, 2227, 7, 885, 1499, 20, 2, 920, 519, 6, 30],
[33, 77, 2228, 526, 65, 4, 6, 144, 77, 135, 4, 2229, 2230],
[22, 2, 188, 236, 20, 147, 9, 254, 40, 6, 179, 77, 72, 1432, 19],
[73, 895, 1026, 36, 7, 73, 430, 4, 73, 129, 163, 200, 720],
[24, 177, 5, 13, 6, 179, 444, 25, 483, 18, 864, 29, 8],
[209, 72, 20, 149, 4, 259, 236, 8, 14, 84, 546, 4, 36, 7, 890, 4],
[236, 2, 2231, 1495, 741, 84, 2232, 11, 2, 490],
[81, 193, 38, 6, 171, 33, 669, 9, 14, 3, 10, 13, 17, 8, 2233],
[419, 6, 2234, 5, 428, 55, 4, 2235, 55, 19, 42, 7, 2],
[629, 34, 166, 56, 654, 2236, 9, 2237, 30, 94, 43, 43, 588],
[108, 134, 2, 137, 324, 5, 45, 9, 206, 171, 588, 358, 635, 16],
[224, 115, 5, 325, 39, 54, 299, 70, 66, 92, 32, 9, 5, 26, 823, 15],
[359, 15, 296, 5, 251, 28, 843, 245, 28, 90, 31, 2, 129],
[252, 32, 38, 3],
[2, 129, 252, 320, 14, 38, 13, 113, 22, 121, 18, 20],
[2, 1338, 4, 2, 2238, 7, 921, 31, 8, 75, 27, 66, 211, 16],
[113, 50, 2, 137, 105, 5, 251, 28, 843, 203, 2, 2239],
[64, 14, 6, 141, 527, 387, 276, 18, 41, 2, 195, 785, 17],
[55, 4, 61, 8, 23, 113, 203, 9, 4, 21, 271, 821, 7, 9, 4],
[319, 9, 9, 1309, 5, 18, 16, 8, 174, 17, 122, 172, 4, 66, 38],
[14, 21, 2, 488, 7, 9],
[8, 1500, 55, 39, 21, 1501, 4, 1005, 123, 2, 1148, 7, 2],
[527, 4, 18, 163, 1149, 887, 381, 7, 6, 141, 183],
[16, 14, 403, 21, 2, 488, 19, 73, 670, 1150, 786, 1502, 6, 144],
[787, 4, 777, 27, 2, 1494, 516, 7, 18, 28, 7, 211, 379],
[388, 2240, 1359, 100, 6, 183],
[2, 183, 4, 13, 113, 20, 526, 90, 25, 96, 65, 11, 360],
[20, 147, 2, 183, 194, 2, 787, 36, 7, 73, 430, 4, 1503],
[18, 11, 6, 2241, 705, 109],
[671, 71, 12, 3, 10, 2, 183],
[24, 14, 27, 76, 1504, 1047, 25, 6, 458, 13, 168],
[190, 2242, 34, 15, 351, 47, 641, 103, 20, 1151, 20, 465, 15, 47],
[79, 15, 14, 61, 15, 115, 39, 24, 738, 31, 15, 91, 15, 89, 56, 134],
[505, 712, 642, 896, 57, 3],
[139, 45, 12, 429, 60, 16, 3, 10, 2, 183, 2243, 1505],
[34, 181, 518, 573, 130, 344, 2244, 10, 13, 1152, 130, 27],
[573, 12, 66, 3],
[34, 85, 66, 3, 10, 2, 183],
[230, 344, 15, 181, 153, 9, 102, 1506, 3, 13, 168, 30, 652],
[567, 15, 181, 579, 9, 573, 5, 347, 19, 4, 235, 29, 298],
[424, 2245, 11, 6, 162, 32, 30, 1153, 3],
[160, 594, 3, 10, 2, 183],
[198, 301, 12, 528, 142, 9, 29, 193, 3, 10, 13, 131, 61, 12],
[56, 5, 471, 69, 6, 2246, 12, 126, 96, 162, 12, 47, 4, 57],
[120, 16, 69, 6, 2247, 15, 166, 91, 872, 482, 9, 6, 33],
[354, 201, 12, 3],
[393, 6, 262, 3, 10, 2, 183],
[198, 301, 67, 1396, 176, 26, 424, 3, 10, 13, 1154, 15, 47],
[32, 9, 59, 482, 30, 354, 5, 70, 3],
[127, 3, 10, 2, 183, 1507, 671, 71, 12, 3],
[97, 1155, 46, 135, 54, 5, 2, 274, 7, 2, 458],
[13, 199, 6, 33, 2248, 20, 2, 2249, 483, 110, 30],
[885, 1156, 4, 8, 779, 55, 39, 4, 10, 30, 1097, 34, 91],
[12, 296, 5, 167, 70, 79, 12, 71, 99, 3],
[210, 3, 10, 2, 183],
[106, 14, 207, 858, 252, 4, 17, 13, 58, 27, 91, 7, 62],
[179, 466, 4, 17, 2, 183, 177, 5, 26, 11, 6, 30, 1348],
[672, 7, 371, 8, 263, 170],
[284, 135, 3, 2, 183, 289, 120, 18, 309, 245, 651],
[5, 95, 3],
[24, 741, 2250, 320, 13, 263, 4, 125, 135, 54],
[2251, 67, 767, 3, 10, 2, 183],
[917, 16, 22, 3, 10, 13, 2252, 40, 18, 1508, 17, 122, 17, 8],
[321, 3, 10, 2, 183],
[13, 63, 8, 174, 17, 122, 2253, 17, 8, 23, 155, 379, 5, 45, 4],
[301, 120, 22, 9, 174, 167, 18, 245, 818, 907, 25, 96],
[384, 9, 2254, 170, 146, 753, 31, 20, 147, 9, 1509, 73],
[670, 194, 2, 787, 36, 7, 73, 430, 54, 4, 10, 592, 12, 91],
[250, 505, 45, 12, 3],
[230, 344, 15, 286, 641, 3, 10, 13, 34, 181, 302, 143, 17, 15],
[269, 4, 15, 85, 365, 2, 195, 324, 25, 727, 384, 468, 3],
[2255, 302, 38, 143, 3, 10, 2, 183],
[198, 224, 232, 5, 95, 92, 1061, 2, 33, 1510, 2256, 31, 9, 22, 125],
[424, 3, 13, 168, 11, 6, 30, 653, 109],
[2257, 12, 71, 218, 673, 580, 3, 10, 2, 183],
[13, 1150, 18, 357, 4, 78],
[127, 71, 218, 673, 580, 3, 2, 768, 788, 10],
[81, 67, 574, 520, 773, 30, 157],
[4, 193, 12, 2258, 789, 21, 67, 104],
[45, 12, 91, 20, 67, 855, 9, 32, 137, 3],
[498, 82, 674, 3, 673, 580, 168, 5, 44, 2259],
[34, 2260, 9, 174, 2261, 2, 2262],
[31, 101, 16, 130, 922, 229, 15, 56, 923],
[239, 15, 45, 9, 54, 4, 54, 3],
[127, 71, 218, 3, 10, 2, 674, 513, 15, 1118, 124],
[4, 56, 590, 431, 2263, 2264],
[193, 12, 263, 6, 135, 1511, 11, 20, 2, 159],
[1512, 38, 32, 2, 466, 7, 16, 3],
[498, 82, 674, 3, 10, 2, 2265, 17, 37, 463, 44, 2266, 1335],
[34, 329, 22, 82, 2267, 30, 2268],
[60, 2, 152, 7, 24, 2269, 42, 2270, 2, 418],
[1086, 70, 5, 1513, 12, 6, 2271, 3],
[127, 71, 218, 3, 10, 2, 674, 81, 67, 1379, 71, 185, 1514],
[25, 211, 2272, 192, 2273],
[193, 12, 348, 2, 1475, 19, 2, 2274, 4, 2, 2275],
[1512, 92, 75, 12, 555, 5, 45, 9, 3],
[498, 82, 674, 3, 10, 44, 673, 34, 194, 5, 2, 888],
[4, 2276, 526, 749, 19, 82, 2277],
[4, 2, 2278, 2279, 97, 9, 285, 5, 82, 2280],
[520, 1515, 2, 428, 7, 82, 326, 3],
[127, 71, 218, 3, 10, 2, 674, 758, 59, 351, 359],
[16, 67, 570, 14, 17, 2281, 17, 214],
[193, 12, 2282, 76, 1516, 21, 2, 223, 7, 67, 595],
[38, 156, 12, 29, 2283, 1517, 3],
[34, 56, 902, 180, 924, 4, 16, 32, 244, 3],
[10, 44, 673, 647, 314, 422, 2284],
[45, 12, 91, 15, 117, 552, 22, 162, 5, 110, 1157],
[26, 72, 28, 187, 1139, 12, 40, 1011, 3],
[288, 32, 27, 10, 137, 3, 10, 2, 183],
[393, 84, 137, 130, 344, 3, 10, 13, 472, 2285, 7, 2, 213],
[56, 115, 2286, 3],
[160, 32, 740, 100, 274, 5, 223, 3, 10, 2, 183, 925, 4],
[64, 14, 360, 25, 96, 384],
[2, 183, 14, 2, 99, 5, 327],
[139, 324, 45, 12, 454, 5, 26, 3, 9, 257],
[197, 130, 27, 660, 17, 5, 324, 3, 13, 267, 168, 884, 42],
[268, 50, 1518, 29, 675, 12, 47, 3],
[34, 85, 47, 3, 10, 2, 183],
[13, 10, 155, 8, 23, 114, 134, 29, 94, 2287, 11, 18, 326],
[124, 4, 8, 199, 16, 8, 14, 2288, 18, 767],
[584, 12, 2289, 101, 3, 10, 2, 183],
[198, 15, 166, 50, 5, 26, 6, 33, 562, 641, 43, 12, 342, 371, 3],
[10, 13, 2290, 633, 32, 110, 6, 1519, 785, 5, 26, 3],
[160, 32, 6, 30, 179, 785, 266, 3, 10, 2, 183, 462, 2291],
[295, 2292, 17, 9, 249, 9, 14, 655, 180, 633, 264],
[131, 130, 27, 269, 5, 9, 3, 1110, 186, 13, 11, 6, 2293, 128, 4],
[8, 63, 7, 55, 34, 208, 2, 459, 342, 26, 29, 891],
[1520, 116, 269, 5, 9, 11, 65, 3, 10, 2, 183, 4, 9, 153, 2],
[787, 69, 73, 430, 4, 78, 1502, 54],
[24, 65, 13, 383, 1521, 852, 9, 1522, 5, 327, 54, 11],
[6, 216, 28, 136, 2, 183, 194, 2, 787, 36, 7, 73, 430],
[4, 1523, 149, 28, 704, 4, 463, 295, 57, 9, 115, 40, 72, 2],
[527, 4, 2294, 170, 11, 2, 921, 1524, 1116, 17, 9, 53],
[758, 253, 126, 165, 12, 325, 1525, 4, 2, 90, 253, 126, 165, 12],
[325, 1526, 3],
[758, 253, 7, 38, 2, 90, 253, 7, 38, 3, 63, 13, 5, 55],
[361, 2, 527, 3, 10, 2, 183, 103, 17, 43, 8, 23, 257, 9],
[711, 4, 11, 207, 164, 9, 14, 36, 7, 410],
[13, 1044, 151, 926, 20, 2, 527, 25, 6, 216, 303],
[5, 165, 36, 97, 52, 2, 136, 821, 7, 9, 4, 17, 9, 14, 922],
[121, 8, 142, 24, 6, 30, 1527, 252, 227, 20, 147, 8],
[1500, 18, 670, 121, 9, 17, 328, 17, 35, 59, 107, 4, 1528, 72, 6, 262],
[7, 2, 1148, 19, 526, 226],
[81, 101, 97, 32, 97, 3, 8, 10, 5, 55, 4, 1529, 6, 33, 7],
[2, 137, 226, 262, 5, 356, 2, 1129, 2, 158, 164, 8, 199, 6, 1530],
[1531, 2295, 18, 577, 9, 23, 1365, 18, 421],
[8, 14, 6, 179, 353, 576, 60, 24, 30, 745, 306, 31, 8, 199],
[16, 64, 14, 48, 65, 5, 26, 1023, 17, 8, 14, 863, 1380, 29, 8],
[209, 5, 93, 20, 149, 5, 251, 96, 7, 2, 90, 262, 18, 577, 14, 1094],
[29, 2296, 419, 18, 421, 16, 64, 14, 351, 335, 5, 561, 18],
[430, 31, 8, 75, 9, 20, 147, 4, 823, 5, 2297, 6, 2298, 7, 2],
[284, 82, 2299, 529, 20, 147, 3, 10, 13, 11, 6, 128, 7, 1027, 97],
[505, 69, 1533, 11, 207, 164, 61, 8, 142, 16, 18, 839],
[52, 1455, 5, 26, 142, 22, 8, 58, 66, 61, 8, 113, 40, 14],
[76, 2300, 2301, 7, 564, 97, 177, 5, 2302, 50, 6, 2303, 36, 7, 6],
[307, 7, 927, 629, 16, 914, 328, 664, 18],
[139, 117, 22, 16, 927, 1157, 26, 3, 10, 13, 81, 291, 56, 82],
[839, 115, 5, 4, 206, 82, 186, 357, 92, 32, 9, 15, 181, 66, 12, 3],
[8, 14, 1143, 46, 41, 17, 8, 249, 31, 48, 2304, 177, 5, 1158],
[559, 6, 33, 1159, 343, 2, 1534, 927, 629],
[17, 64, 177, 5, 26, 48, 901, 7, 205, 18, 357, 39, 5, 18, 104, 8],
[232, 5, 116, 18, 104, 40, 5, 46, 4, 14, 1488, 5, 215, 16, 18],
[564, 59, 1445, 41, 891, 11, 62, 771, 50, 6, 596, 8, 23],
[103, 1160, 11, 2305, 9, 40, 69, 6, 2306, 2307, 4, 14, 178],
[5, 2308, 11, 343, 2, 629, 97, 8, 142, 5, 26, 155, 31, 2, 2309],
[7, 2, 593, 203, 97, 8, 23, 134, 1535, 61, 6, 666, 2310, 156],
[18, 597, 135, 11, 6, 382, 6, 141, 366, 23, 2311, 69, 18, 283, 4],
[14, 1536, 18, 854, 19, 73, 2312],
[1537, 3, 928, 2, 366],
[230, 27, 6, 596, 3, 10, 13, 929, 1080, 70, 746, 3],
[1537, 15, 95, 54, 3, 432, 2, 366, 31, 11, 6, 102, 2313, 128],
[4, 202, 19, 6, 502, 7, 2314, 309, 232, 345, 77, 4, 155, 743],
[5, 1117, 46, 3],
[34, 528, 2, 465, 277, 38, 250, 261, 41, 3, 10, 13],
[309, 232, 2, 1538, 7, 593, 4, 224, 232, 2315, 4, 224, 232],
[2316, 3, 2, 366, 53, 21, 146, 1109, 5, 18, 131, 381],
[1161, 255, 48, 2317, 46, 3],
[13, 14, 102, 4, 102, 473, 31, 8, 63, 64, 14, 48, 152, 11],
[280, 211, 102, 236, 2, 366, 23, 348],
[513, 43, 9, 396, 623, 244, 2318, 2, 790, 3, 10, 2, 366],
[131, 15, 89, 26, 21, 2, 172, 36, 25, 1161, 715, 4, 162, 239, 15],
[528, 23, 6, 1390, 7, 676, 256, 180, 2319, 3],
[230, 30, 2320, 677, 134, 2321, 3, 10, 13, 79, 14, 274, 5],
[66, 73, 517],
[81, 103, 17, 588, 930, 2, 2322, 530, 11, 2, 525, 3, 460, 2],
[366, 2323, 73, 109, 5, 6, 778, 81, 103, 17, 15, 14, 425, 15],
[166, 26, 529, 7, 46, 20, 147, 35, 89, 2324, 150, 2325, 40, 100],
[2, 780, 2326, 596, 3],
[131, 130, 27, 6, 596, 15, 167, 12, 3, 10, 13, 230, 6, 130, 6, 3],
[198, 38, 71, 12, 3, 10, 2, 366, 34, 117, 66, 250, 303, 5],
[2327, 245, 3],
[34, 130, 6, 33, 829, 3, 10, 13, 190, 1539, 17, 8, 730],
[2, 510, 7, 1540, 8, 23, 336, 260, 16, 162],
[390, 710, 521, 266, 3, 10, 2, 366, 11, 6, 128, 7, 2, 2328],
[2329, 309, 275, 6, 179, 298, 33, 1162, 11, 82, 65, 31, 114, 42],
[19, 110, 6, 564, 17, 16, 48, 48, 250, 6, 596, 4, 255, 48, 152],
[2330, 9, 15, 359, 872, 26, 1541, 70, 158, 16, 12, 114, 1163, 76],
[34, 56, 1163, 790, 320, 3, 10, 13, 79, 14, 6, 30, 2332],
[386, 131, 33, 1162, 251, 790, 84, 17, 94, 17, 1161, 45, 12],
[34, 85, 461, 9, 3, 10, 2, 366, 131, 43, 35, 45, 239, 57, 433],
[6, 502, 7, 596, 241, 22, 15, 117, 95, 3],
[24, 14, 110, 6, 628, 277, 5, 13, 16, 8, 14, 84, 598, 25, 6],
[216, 28, 136, 97, 285, 2, 366, 2, 444, 7, 2333, 658],
[151, 25, 790, 15, 47, 16, 122, 244, 4, 38, 464, 9, 448, 5, 70],
[372, 250, 6, 33, 829, 28, 6, 596, 3],
[160, 1542, 6, 179, 353, 5, 70, 3, 10, 13, 267, 131, 130, 27, 151],
[25, 790, 17, 9, 732, 4, 43, 15, 14, 15, 776, 454, 1164, 15, 85],
[50, 46, 2334, 3],
[198, 26, 72, 57, 3, 10, 2, 366, 11, 6, 1085, 128, 17, 9, 1165],
[40, 54, 69, 73, 2335, 13, 2336, 40, 343, 2, 593, 17, 122, 17],
[8, 58, 25, 18, 564, 329, 205, 1543, 343, 2, 1544, 4],
[345, 101, 4, 57, 8, 23, 5, 639, 4, 2337, 9, 120, 6, 188, 8],
[730, 16, 8, 317, 916, 2, 1166, 7, 527, 11, 18, 357, 4],
[8, 209, 5, 93, 30, 1115, 1167, 99, 20, 42, 4, 57, 20, 2],
[90, 4, 387, 716, 1525, 4, 716, 1526, 852, 8, 23],
[1160, 11, 1168, 55, 40, 5, 18, 737, 785],
[9, 14, 29, 144, 896, 8, 23, 134, 211, 276, 2, 137, 324, 16, 9],
[199, 84, 742, 20, 99, 31, 8, 115, 269, 5, 9, 11, 6, 414, 384],
[4, 78, 261, 5, 55, 17, 737, 284, 255, 200, 82, 918, 287],
[101, 92, 858, 22, 256, 1540, 71, 130, 114, 229, 38, 130, 178],
[5, 26, 100, 42, 216, 5, 207, 227, 224, 115, 135, 5, 82, 137],
[324, 2, 158, 105, 32, 5, 116, 69, 16, 397, 265, 92, 32, 16],
[5, 26, 287, 15, 238, 3, 17, 8, 10, 24, 8, 125, 315, 173, 76, 561],
[469, 19, 6, 33, 240, 11, 9, 41, 489, 231, 264, 2338, 1545],
[64, 3, 63, 13, 2339, 114, 45, 5, 150, 173, 46, 24, 324, 239],
[15, 166, 2340, 46, 36, 7, 98, 2341, 3, 29, 8, 78, 1167, 20, 2],
[2342, 262, 54, 4, 75, 27, 1114, 5, 107, 276, 2, 240, 236, 8],
[23, 1155, 55, 40, 5, 851, 633, 264],
[388, 2343, 398, 4, 599],
[25, 6, 216, 28, 136, 8, 589, 151, 20, 2, 240, 4, 558, 38],
[5, 45, 158, 61, 315, 6, 337, 11, 1169, 125, 519, 36, 7, 2],
[525, 8, 1170, 118, 5, 26, 6, 337, 323, 37, 14, 11, 1169],
[931, 2344, 60, 44, 283, 108, 8, 59, 56, 289, 118, 6],
[531, 4, 2345, 1171, 20, 2, 159, 19, 44, 2346, 9, 14, 413],
[60, 207, 337, 11, 1169, 19, 6, 121, 283, 4, 141, 163, 50, 6],
[1088, 4, 271, 2347, 13, 487, 23, 2348, 574, 16, 1461, 22],
[123, 98, 408, 8, 199, 30, 234, 5, 47, 38, 9, 14, 22, 41],
[4, 2349, 6, 33, 77, 36, 7, 2, 525, 5, 552],
[2, 531, 337, 78, 60, 2350, 100, 203, 44, 292, 6, 129, 932],
[358, 17, 141, 17, 640, 4, 24, 37, 1096, 123, 5, 2, 90],
[280, 11, 6, 1103, 128, 567, 2, 132, 76, 1546, 100, 2, 68],
[5, 508, 453, 3, 2, 1088, 337, 432, 11, 2, 195, 1103, 128],
[108, 1518, 2, 1172, 7, 2, 213, 6, 33, 2351, 2, 68, 76],
[1546, 25, 2, 132, 5, 508, 453, 3],
[57, 35, 271, 886, 281, 4, 98, 2352, 115, 1543, 468],
[13, 1547, 29, 94, 20, 24, 16, 8, 23, 5, 900, 135, 69, 2],
[525, 25, 822, 7, 98, 907, 18, 4, 61, 8, 158, 1005, 36, 2],
[531, 337, 14, 336, 4, 2, 90, 14, 403, 21, 2, 532, 276, 2],
[159, 1173, 2353, 39, 69, 2, 780],
[13, 53, 472, 39, 5, 2, 159, 4, 2354],
[600, 48, 225, 7, 152, 11, 1124, 3, 10, 2, 337, 81, 16, 25],
[136, 2355, 99, 323, 130, 21, 2, 195, 253, 7, 2, 159, 17, 12],
[71, 1548, 323, 433, 483, 110, 6, 1104, 1549, 48, 42, 58],
[1039, 294, 12, 3, 4, 320, 64, 14, 6, 431, 1550, 1104],
[178, 21, 678, 6, 1174, 1175, 4, 679, 4, 345, 101, 4, 57],
[6, 129, 1136, 17, 43, 6, 933, 28, 2356, 23, 134, 662, 5, 1166],
[892, 57, 3, 10, 13, 270, 286, 15, 5, 116, 11, 3],
[868, 174, 26, 96, 1142, 11, 67, 1124, 3, 2, 337, 53, 21],
[146, 1109, 5, 18, 217, 175, 23, 2, 159, 680, 290, 25, 1176],
[43, 12, 52, 1549, 12, 174, 2357, 4, 15, 58, 299, 12, 36, 12, 47, 3],
[37, 14, 151, 39, 69, 2, 780, 22, 2, 65, 37, 14, 753, 4, 24],
[13, 63, 925, 2358, 131, 301, 37, 181, 392, 9, 3, 8],
[10, 5, 55, 2359, 163, 71, 29, 30, 358, 20, 2, 488, 7, 44, 104],
[31, 20, 62, 451, 37, 174, 447, 924, 92, 286, 15, 5, 116, 11, 3, 8],
[34, 189, 649, 106, 3, 2, 337, 434, 1551, 2360, 3],
[20, 24, 164, 2, 159, 7, 2, 240, 413, 4, 6, 141, 1123, 125],
[2361, 36, 1313, 20, 2, 2362, 104, 9, 103, 2363, 44, 595],
[4, 1528, 5, 1166, 419, 42, 7, 2, 593, 319, 118],
[3, 28, 158, 162, 1552, 3, 2, 337, 460, 11, 2, 195, 128, 655],
[17, 43, 155, 23, 563],
[270, 286, 15, 5, 116, 11, 3, 257, 13, 54, 11, 6, 2364, 128],
[584, 12, 5, 116, 11, 20, 22, 3, 10, 2, 337, 272, 2, 99],
[252, 12, 47, 3],
[9, 14, 48, 913, 108, 13, 75, 27, 50, 5, 26, 681, 29, 196, 415],
[1553, 3, 8, 1554, 5, 55, 219, 77, 22, 2, 459, 2365],
[145, 244, 5, 2366, 42, 2367, 3],
[2, 337, 177, 5, 91, 24, 6, 179, 444, 25, 1177, 44],
[435, 19, 2368, 34, 189, 649, 106, 3, 37, 10, 2369, 4, 72, 25],
[533, 4, 533, 3],
[131, 38, 286, 15, 5, 45, 3, 10, 13],
[2370, 12, 50, 3, 10, 2, 337, 4, 78, 2371],
[197, 255, 48, 152, 11, 261, 5, 118, 3, 10, 13, 2372, 2373],
[922, 2374, 3, 4, 8, 413, 2, 159, 4, 53, 11],
[2, 159, 838, 137, 69, 6, 141, 934, 97, 14, 237, 7, 2375, 100],
[42, 223, 5, 2, 90, 2, 132, 14, 403, 21, 6, 180, 1334, 2376, 11],
[2, 494, 1178, 6, 310, 2, 338, 14, 1555, 123, 2, 866, 1556],
[6, 141, 1557, 97, 177, 5, 26, 237, 7, 246],
[600, 320, 185, 94, 599, 11, 16, 246, 3, 13, 10, 5, 55],
[17, 122, 17, 8, 58, 25, 679],
[64, 14, 320, 185, 94, 7, 9, 11, 2, 279, 212, 2, 132],
[2377, 2378, 4, 17, 25, 2, 310, 9, 14, 679, 4, 1175],
[2379, 146, 6, 1558, 1559, 2, 108, 143, 11, 2, 934],
[16, 75, 27, 1560, 52, 2, 338, 4, 6, 141, 138, 97, 14, 403, 21],
[2, 2380, 4, 2381, 100, 682, 5, 682],
[892, 59, 12, 167, 70, 3, 10, 13, 6, 33, 472, 25, 8, 14],
[27, 84, 229, 372, 9, 14, 179, 2382, 25, 18, 5, 327, 99, 210],
[67, 138, 2383, 50, 16, 3],
[196, 6, 683, 138, 3, 10, 2, 132, 81, 241, 239, 398, 3],
[8, 10, 2, 147, 376, 19, 110, 745, 2384, 16, 13, 84],
[630, 31, 8, 297, 11, 207, 164, 16, 9, 14, 1503, 5, 2, 310],
[4, 27, 5, 18, 29, 8, 194, 1179, 4, 53, 21, 54],
[34, 300, 47, 16, 683, 318, 330, 1180, 11, 497, 15, 300, 47],
[16, 318, 58, 644, 3],
[420, 22, 117, 3, 10, 2, 132, 81, 431, 7, 1138, 45, 3],
[34, 85, 47, 7, 62, 16, 45, 3, 13, 10, 30, 652, 566, 84],
[601, 5, 56, 115, 69, 6, 458],
[127, 85, 47, 94, 3, 10, 2, 132, 81, 241, 6, 497, 3],
[13, 75, 27, 20, 22, 50, 2, 128, 7, 24, 435, 4, 63, 9, 59],
[26, 17, 122, 5, 1561, 96, 90, 583, 7, 458, 188, 8],
[14, 303, 5, 1562, 21, 42, 2, 338, 194, 2, 1557, 7, 246, 72, 2],
[866, 4, 20, 149, 209, 5, 93, 1563, 355, 678, 18, 846, 20],
[2, 132, 4, 2, 310, 2, 866, 2385, 125, 99, 57, 499, 6],
[1482, 7, 2386, 1564, 4, 1565, 2, 132, 194, 48, 516, 7],
[46, 212, 61, 35, 1485, 18, 4, 2, 310, 14, 1175, 29, 94, 1181],
[16, 9, 14, 84, 1029, 5, 95, 372, 2, 2387, 1022, 9, 28, 27],
[197, 242, 371, 38, 250, 770, 3, 228, 13, 935, 39, 4, 40, 11],
[76, 2388, 7, 2389, 197, 64, 575, 44, 2390, 2391, 17, 76, 2392],
[141, 2393, 2394, 316, 60, 9, 4, 30, 358, 936, 9, 72],
[217, 684, 2395, 98, 405, 467, 3, 2, 132, 10, 11, 6, 1063],
[1182, 219, 549, 59, 107, 121, 6, 353, 1183, 192, 9, 464, 3],
[840, 59, 27, 26, 76, 1184, 3, 10, 13, 79, 199, 30, 375, 5, 116],
...]
len(tokenizer.index_word)
3317
vocab_size = 3001
# V = vocab_size
X = []
y = []
for sentence in doc2:
inputs = []
targets = []
for i in range(1, len(sentence)):
if i ==1:
inputs.append(sentence[0:i])
else:
inputs.append(sentence[i-2:i])
targets.append(sentence[i])
inputs_sequence = sequence.pad_sequences(inputs, maxlen=2)
X.extend(inputs_sequence)
y.extend(targets)
Y = np.array(y)
len(X),len(Y)
(28037, 28037)
Y
array([1297, 273, 402, ..., 660, 722, 1])
X = np.array(X)
X
array([[ 0, 51],
[ 51, 1297],
[1297, 273],
...,
[ 19, 62],
[ 62, 660],
[ 660, 722]])
X[0]
array([ 0, 51])
#y =b + Wx +utanh(d + Hx)
whz_input = Input((2,), dtype='int32', name='main_input' )
em = Embedding(output_dim=128, input_dim=vocab_size, input_length=2)
x1 = em(whz_input)
x1 = Reshape((128*2,))(x1)
x2 = em(whz_input)
x2 = Reshape((128*2,))(x2)
x1 = Dense(256, activation='tanh')(x1)
x = Concatenate()([x1, x2])
y = Dense(vocab_size, activation='softmax',name='main_output')(x)
model = Model(inputs=[whz_input], outputs=[y])
model.compile(optimizer='adam',
loss= 'sparse_categorical_crossentropy',
metrics = ['accuracy']
)
model.summary()
Model: "model"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
main_input (InputLayer) [(None, 2)] 0 []
embedding (Embedding) (None, 2, 128) 384128 ['main_input[0][0]',
'main_input[0][0]']
reshape (Reshape) (None, 256) 0 ['embedding[0][0]']
dense (Dense) (None, 256) 65792 ['reshape[0][0]']
reshape_1 (Reshape) (None, 256) 0 ['embedding[1][0]']
concatenate (Concatenate) (None, 512) 0 ['dense[0][0]',
'reshape_1[0][0]']
main_output (Dense) (None, 3001) 1539513 ['concatenate[0][0]']
==================================================================================================
Total params: 1,989,433
Trainable params: 1,989,433
Non-trainable params: 0
__________________________________________________________________________________________________
##graphviz
tf.keras.utils.plot_model(model, to_file='NNLM.png', show_shapes=True, show_layer_names=True,dpi=200)
history = model.fit(X,Y,epochs=2,batch_size=256,verbose=1)
Epoch 1/2
110/110 [==============================] - 3s 20ms/step - loss: 6.7649 - accuracy: 0.0673
Epoch 2/2
110/110 [==============================] - 2s 20ms/step - loss: 5.5747 - accuracy: 0.1020
model.save_weights('./model/simple')
#y =b + Wx +utanh(d + Hx)
whz_input = Input((2,), dtype='int32', name='main_input' )
em = Embedding(output_dim=128, input_dim=vocab_size, input_length=256,trainable=False)
x1 = em(whz_input)
x1 = Reshape((128*2,))(x1)
x2 = em(whz_input)
x2 = Reshape((128*2,))(x2)
x1 = Dense(256, activation='tanh')(x1)
x = Concatenate()([x1, x2])
y = Dense(vocab_size, activation='softmax',name='main_output')(x)
model2 = Model(inputs=[whz_input], outputs=[y])
model2.compile(optimizer='adam',
loss= 'sparse_categorical_crossentropy',
metrics = ['accuracy']
)
model2.summary()
Model: "model_1"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
main_input (InputLayer) [(None, 2)] 0 []
embedding_1 (Embedding) (None, 2, 128) 384128 ['main_input[0][0]',
'main_input[0][0]']
reshape_2 (Reshape) (None, 256) 0 ['embedding_1[0][0]']
dense_1 (Dense) (None, 256) 65792 ['reshape_2[0][0]']
reshape_3 (Reshape) (None, 256) 0 ['embedding_1[1][0]']
concatenate_1 (Concatenate) (None, 512) 0 ['dense_1[0][0]',
'reshape_3[0][0]']
main_output (Dense) (None, 3001) 1539513 ['concatenate_1[0][0]']
==================================================================================================
Total params: 1,989,433
Trainable params: 1,605,305
Non-trainable params: 384,128
__________________________________________________________________________________________________
em.weights
[<tf.Variable 'embedding_1/embeddings:0' shape=(3001, 128) dtype=float32, numpy=
array([[ 0.00038725, 0.02980028, -0.04478078, ..., -0.04746876,
0.02096316, -0.03550763],
[-0.02341582, 0.04243669, -0.0188946 , ..., 0.04336881,
0.00876683, -0.0476369 ],
[ 0.02262891, 0.01916197, -0.00795548, ..., 0.00506271,
0.04929343, 0.00285642],
...,
[-0.01228237, -0.01409857, 0.00656865, ..., 0.03748634,
-0.01987431, -0.01313651],
[ 0.00272141, -0.00801326, -0.01249127, ..., -0.03974063,
-0.0337764 , -0.01392176],
[ 0.04625108, 0.01522206, -0.02326363, ..., -0.04364833,
-0.04237036, -0.02878901]], dtype=float32)>]
model2.load_weights('./model/simple')
<tensorflow.python.checkpoint.checkpoint.CheckpointLoadStatus at 0x2221fbfb730>
em.weights
[<tf.Variable 'embedding_1/embeddings:0' shape=(3001, 128) dtype=float32, numpy=
array([[-0.04999013, -0.01754446, -0.08487866, ..., 0.01223448,
-0.05963103, -0.04613758],
[-0.10100415, -0.01166014, 0.0399812 , ..., -0.03869348,
0.04609768, -0.06704105],
[ 0.04490609, 0.0548879 , -0.15027255, ..., -0.06666258,
0.11025386, 0.09745732],
...,
[-0.01293475, 0.02630728, 0.05848833, ..., 0.03171974,
0.05663816, -0.0002611 ],
[ 0.05058005, 0.00186029, 0.03195685, ..., -0.04599798,
-0.02905085, 0.03925655],
[-0.04459233, 0.04952293, 0.00294762, ..., 0.04066138,
-0.01630092, 0.03472063]], dtype=float32)>]
微调下游任务
imdb = keras.datasets.imdb
(train_data, train_labels), (test_data, test_labels) = imdb.load_data(num_words=3000)
Downloading data from https://storage.googleapis.com/tensorflow/tf-keras-datasets/imdb.npz
17464789/17464789 [==============================] - 4s 0us/step
print("Training entries: {}, labels: {}".format(len(train_data), len(train_labels)))
Training entries: 25000, labels: 25000
print(train_data[0])
[1, 14, 22, 16, 43, 530, 973, 1622, 1385, 65, 458, 2, 66, 2, 4, 173, 36, 256, 5, 25, 100, 43, 838, 112, 50, 670, 2, 9, 35, 480, 284, 5, 150, 4, 172, 112, 167, 2, 336, 385, 39, 4, 172, 2, 1111, 17, 546, 38, 13, 447, 4, 192, 50, 16, 6, 147, 2025, 19, 14, 22, 4, 1920, 2, 469, 4, 22, 71, 87, 12, 16, 43, 530, 38, 76, 15, 13, 1247, 4, 22, 17, 515, 17, 12, 16, 626, 18, 2, 5, 62, 386, 12, 8, 316, 8, 106, 5, 4, 2223, 2, 16, 480, 66, 2, 33, 4, 130, 12, 16, 38, 619, 5, 25, 124, 51, 36, 135, 48, 25, 1415, 33, 6, 22, 12, 215, 28, 77, 52, 5, 14, 407, 16, 82, 2, 8, 4, 107, 117, 2, 15, 256, 4, 2, 7, 2, 5, 723, 36, 71, 43, 530, 476, 26, 400, 317, 46, 7, 4, 2, 1029, 13, 104, 88, 4, 381, 15, 297, 98, 32, 2071, 56, 26, 141, 6, 194, 2, 18, 4, 226, 22, 21, 134, 476, 26, 480, 5, 144, 30, 2, 18, 51, 36, 28, 224, 92, 25, 104, 4, 226, 65, 16, 38, 1334, 88, 12, 16, 283, 5, 16, 2, 113, 103, 32, 15, 16, 2, 19, 178, 32]
len(train_data[0]), len(train_data[1])
(218, 189)
train_data = keras.preprocessing.sequence.pad_sequences(train_data,
value=0,
padding='post',
maxlen=256)
test_data = keras.preprocessing.sequence.pad_sequences(test_data,
value=0,
padding='post',
maxlen=256)
train_data[0]
array([ 1, 14, 22, 16, 43, 530, 973, 1622, 1385, 65, 458,
2, 66, 2, 4, 173, 36, 256, 5, 25, 100, 43,
838, 112, 50, 670, 2, 9, 35, 480, 284, 5, 150,
4, 172, 112, 167, 2, 336, 385, 39, 4, 172, 2,
1111, 17, 546, 38, 13, 447, 4, 192, 50, 16, 6,
147, 2025, 19, 14, 22, 4, 1920, 2, 469, 4, 22,
71, 87, 12, 16, 43, 530, 38, 76, 15, 13, 1247,
4, 22, 17, 515, 17, 12, 16, 626, 18, 2, 5,
62, 386, 12, 8, 316, 8, 106, 5, 4, 2223, 2,
16, 480, 66, 2, 33, 4, 130, 12, 16, 38, 619,
5, 25, 124, 51, 36, 135, 48, 25, 1415, 33, 6,
22, 12, 215, 28, 77, 52, 5, 14, 407, 16, 82,
2, 8, 4, 107, 117, 2, 15, 256, 4, 2, 7,
2, 5, 723, 36, 71, 43, 530, 476, 26, 400, 317,
46, 7, 4, 2, 1029, 13, 104, 88, 4, 381, 15,
297, 98, 32, 2071, 56, 26, 141, 6, 194, 2, 18,
4, 226, 22, 21, 134, 476, 26, 480, 5, 144, 30,
2, 18, 51, 36, 28, 224, 92, 25, 104, 4, 226,
65, 16, 38, 1334, 88, 12, 16, 283, 5, 16, 2,
113, 103, 32, 15, 16, 2, 19, 178, 32, 0, 0,
0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0])
# vocab_size =
model = keras.Sequential()
model.add(em)
model.add(keras.layers.GlobalAveragePooling1D())
model.add(keras.layers.Dense(16, activation='relu'))
model.add(keras.layers.Dense(1, activation='sigmoid'))
model.summary()
Model: "sequential"
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) multiple 384128
global_average_pooling1d (G (None, 128) 0
lobalAveragePooling1D)
dense_2 (Dense) (None, 16) 2064
dense_3 (Dense) (None, 1) 17
=================================================================
Total params: 386,209
Trainable params: 2,081
Non-trainable params: 384,128
_________________________________________________________________
model.compile(optimizer='adam',
loss='binary_crossentropy',
metrics=['accuracy'])
x_val = train_data[:10000]
partial_x_train = train_data[10000:]
y_val = train_labels[:10000]
partial_y_train = train_labels[10000:]
history = model.fit(partial_x_train,
partial_y_train,
epochs=1,
batch_size=512,
validation_data=(x_val, y_val),
verbose=1)
30/30 [==============================] - 1s 30ms/step - loss: 0.6932 - accuracy: 0.4965 - val_loss: 0.6929 - val_accuracy: 0.5095
pytorch实现NNLM
import torch
import torch.nn as nn
import torch.optim as optim
# 定义NNLM模型
class NNLM(nn.Module):
def __init__(self, vocab_size, embed_size, hidden_size, context_size):
super(NNLM, self).__init__()
self.embeddings = nn.Embedding(vocab_size, embed_size)
self.linear1 = nn.Linear(context_size * embed_size, hidden_size)
self.linear2 = nn.Linear(hidden_size, vocab_size)
def forward(self, inputs):
embeds = self.embeddings(inputs).view((1, -1))
out = torch.relu(self.linear1(embeds))
out = self.linear2(out)
log_probs = torch.log_softmax(out, dim=1)
return log_probs
# 生成训练数据
def generate_training_data(text, context_size):
data = []
for i in range(len(text) - context_size):
context = text[i:i+context_size]
target = text[i+context_size]
data.append((context, target))
return data
# 词汇表
vocab = ["我们", "喜欢", "学习", "深度", "学习", "模型"]
word_to_ix = {word: i for i, word in enumerate(vocab)}
ix_to_word = {i: word for i, word in enumerate(vocab)}
# 训练数据
context_size = 2
text = ["我们", "喜欢", "学习", "深度", "学习"]
data = generate_training_data(text, context_size)
# 模型参数
vocab_size = len(vocab)
embed_size = 10
hidden_size = 20
learning_rate = 0.01
# 初始化模型
model = NNLM(vocab_size, embed_size, hidden_size, context_size)
loss_function = nn.NLLLoss()
optimizer = optim.SGD(model.parameters(), lr=learning_rate)
# 训练模型
epochs = 50
for epoch in range(epochs):
total_loss = 0
for context, target in data:
context_idxs = torch.tensor([word_to_ix[w] for w in context], dtype=torch.long)
target_idx = torch.tensor([word_to_ix[target]], dtype=torch.long)
model.zero_grad()
log_probs = model(context_idxs)
loss = loss_function(log_probs, target_idx)
loss.backward()
optimizer.step()
total_loss += loss.item()
print(f'Epoch: {epoch + 1}, Loss: {total_loss/len(data)}')
# 测试模型
context = ["我们", "喜欢"]
context_idxs = torch.tensor([word_to_ix[w] for w in context], dtype=torch.long)
with torch.no_grad():
log_probs = model(context_idxs)
predicted_idx = torch.argmax(log_probs, dim=1).item()
print(f'Given context: {" ".join(context)}, predicted word: {ix_to_word[predicted_idx]}')
Epoch: 1, Loss: 1.790592352549235
Epoch: 2, Loss: 1.7119063138961792
Epoch: 3, Loss: 1.6365853150685628
Epoch: 4, Loss: 1.5643590688705444
Epoch: 5, Loss: 1.4942808945973713
Epoch: 6, Loss: 1.4260926644007366
Epoch: 7, Loss: 1.35993496576945
Epoch: 8, Loss: 1.2956924239794414
Epoch: 9, Loss: 1.2340239485104878
Epoch: 10, Loss: 1.1765665809313457
Epoch: 11, Loss: 1.1213226914405823
Epoch: 12, Loss: 1.0684139529863994
Epoch: 13, Loss: 1.0179905891418457
Epoch: 14, Loss: 0.9701371987660726
Epoch: 15, Loss: 0.9248658319314321
Epoch: 16, Loss: 0.8821176389853159
Epoch: 17, Loss: 0.8417720794677734
Epoch: 18, Loss: 0.8041159311930338
Epoch: 19, Loss: 0.770838220914205
Epoch: 20, Loss: 0.7393125693003336
Epoch: 21, Loss: 0.7093108793099722
Epoch: 22, Loss: 0.6806128869454066
Epoch: 23, Loss: 0.6530134429534277
Epoch: 24, Loss: 0.626327633857727
Epoch: 25, Loss: 0.6003943880399069
Epoch: 26, Loss: 0.5750780353943507
Epoch: 27, Loss: 0.5502694547176361
Epoch: 28, Loss: 0.5258867690960566
Epoch: 29, Loss: 0.5018747101227442
Epoch: 30, Loss: 0.4782043571273486
Epoch: 31, Loss: 0.45487141857544583
Epoch: 32, Loss: 0.43189482887585956
Epoch: 33, Loss: 0.4093136837085088
Epoch: 34, Loss: 0.3871843069791794
Epoch: 35, Loss: 0.3655760983626048
Epoch: 36, Loss: 0.34456662088632584
Epoch: 37, Loss: 0.32423675805330276
Epoch: 38, Loss: 0.3046655133366585
Epoch: 39, Loss: 0.2859252020716667
Epoch: 40, Loss: 0.2680772046248118
Epoch: 41, Loss: 0.25116871545712155
Epoch: 42, Loss: 0.23523097982009253
Epoch: 43, Loss: 0.2202786641816298
Epoch: 44, Loss: 0.20631006980935732
Epoch: 45, Loss: 0.1933088650306066
Epoch: 46, Loss: 0.18124636635184288
Epoch: 47, Loss: 0.17008367801705995
Epoch: 48, Loss: 0.15977458904186884
Epoch: 49, Loss: 0.15026815856496492
Epoch: 50, Loss: 0.14151045059164366
Given context: 我们 喜欢, predicted word: 学习
扫一扫
934
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
