jddlZddlZddlmZdZGddZd dZdZdZd Z dd Z e d kr e dSdS)N) Nonterminali@Bc"eZdZdZdZdZdZdS)_GenerationBudgetzCounts derivation-expansion steps and aborts runaway generation. The whole enumeration shares one budget, so it bounds total work however the caller consumes the iterator (one ``next()`` or a full ``list()``).  remaininglimitc"||_||_dS)Nr)selfrs v/home/lighthouse/badge-speaker-benchmark/.benchmark-venv-community/lib/python3.11/site-packages/nltk/parse/generate.py__init__z_GenerationBudget.__init__$s cj|xjdzc_|jdkrtd|jzdS)Nra'Refusing to generate further: a recursive grammar can derive an exponential number of sentences, and generation exceeded the limit of %d derivation-expansion steps (CWE-400). Pass a smaller 'depth' or 'n', remove cyclic/self-embedding rules, or raise nltk.parse.generate.MAX_GENERATE_OPERATIONS.)r ValueErrorr)r s r spendz_GenerationBudget.spend(sN ! >A  EHLz R   r N)__name__ __module__ __qualname____doc__ __slots__r rr r rrsC 'I     r rc|s|}|tjdzdz }tt}t ||g||}|t j||}|S)a= Generates an iterator of all sentences from a CFG. :param grammar: The Grammar used to generate sentences. :param start: The Nonterminal from which to start generate sentences. :param depth: The maximal depth of the generated tree. :param n: The maximum number of sentences to return. :return: An iterator of lists of terminal tokens. :raise ValueError: if generation exceeds ``MAX_GENERATE_OPERATIONS`` derivation-expansion steps, which a recursive grammar reaches with the default ``depth`` and no ``n`` limit (CWE-400). N)startsysgetrecursionlimitrMAX_GENERATE_OPERATIONS _generate_all itertoolsislice)grammarrdepthnbudgetiters r generater&4sw    }&((A-2 6 7 7F 5'5& 9 9D }a(( Kr c#K|rx t||d||D]:}t||dd||D]}|||zV;dS#t$r}t d|d}~wwxYwgVdS)Nrrz}The grammar has rule(s) that yield infinite recursion! Eventually use a lower 'depth', or a higher 'sys.setrecursionlimit()'.) _generate_onerrRecursionError RuntimeError)r!itemsr"r$frag1frag2errors r rrRs  &wa%HH ( (*7E!""IufMM((E LLNNN%-''''( ( (   H  sAA A:%A55A:c#K||dkrdt|trH||D]/}t |||dz |Ed{V0dS|gVdSdS)Nr)lhsr)r isinstancer productionsrrhs)r!itemr"r$prods r r(r(hs LLNNN qyy dK ( ( +++55 Q Q($((**eaiPPPPPPPPPP Q Q&LLLLL yr z S -> NP VP NP -> Det N PP -> P NP VP -> 'slept' | 'saw' NP | 'walked' PP Det -> 'the' | 'a' N -> 'man' | 'park' | 'dog' P -> 'in' | 'with' c,ddlm}td|fztt|t}t t ||dD],\}}td|d|fz-dS)Nr)CFGz3Generating the first %d sentences for demo grammar:)r#rz%3d. %s ) nltk.grammarr8print demo_grammar fromstring enumerater&join)Nr8r!r#sents r demorBs       ?1$ FGGG ,nn\**GXg333Q77//4 i1chhtnn--....//r __main__)NNN)r6) rrr:rrrr&rr(r<rBrrr r rDs $$$$$$$2<,    //// zDFFFFFr