Search DaniWeb - lexer

Re: What does this mean? (Code Snip) 13 Years Ago by digitig "Lexer" is a standard thing, but it's only common … Re: Lexer - What it is? 14 Years Ago by NathanOliver a lexer is a program that runs through text and converts it into something you can use in your program an example would be a program that lets you input something like 5x^5 - 3x^3 + 20x^2 +5x -15. it would convert all of those into tokens that your program can use to output a solution. at least this is what i believe it is. Re: Lexer - What it is? 14 Years Ago by jonsca [URL="http://dinosaur.compilertools.net/lex/index.html"]This [/URL]goes very much in depth but seems to have some good background in the beginning. Lex is a specific lexer but the concepts are the same. Re: Lexer - What it is? 14 Years Ago by Narue The lexer turns source code into something that's easier to parse. That's really all there is to it. ;) Re: Lexer - What it is? 14 Years Ago by Stefano Mtangoo [QUOTE=Narue;1131967]The lexer turns source code into something that's easier to parse. That's really all there is to it. ;)[/QUOTE] So it turns source code into something IT can parse. So you mean it have nothing to do with human readable part. Have I got you well? Re: Lexer- Tokenizer problem 16 Years Ago by vijayan121 …() { vector<string> test_cases = list_of ( "test daniweb lexer xyz tokenizer lexer" ) ( "daniweblexer tokenizerlexer abcd lexerlexer" ) ( "….cpp && ./a.out parsed: test daniweb lexer xyz tokenizer lexer tokens: STRING SPACE WEB SPACE LEX SPACE STRING SPACE… Haskell lexer help 12 Years Ago by ckwolfe … '\'' -> result1 : result2 where result1 = TokPos pos (reserved [x]) result2 = lexer xs newPos newPos = updatePosChar pos x x:xs | isSep1 [x… (incSourceCol pos 1) x:_ -> error (show pos ++ ": Lexer error: unknown character " ++ [x]) [] -> [] where identifierOrKeyword :: String -&… wxPython wx.stc.StyledTextCtrl custom Lexer 13 Years Ago by saulius ….stc lexers. It should be possible to add my own lexer, but how do I do it? If it is not… possible to add my own lexer, is there a workaround so I can still style every… wx.stc.StyledTextCtrl and custom lexer 10 Years Ago by deonis Hi everyone, I have a problem to setup a custom lexer using in wx.stc.StyledTextCtrl (wxPython). I have a text … way. Here is my code: First, I create a custom lexer and then bind wx.stc.EVT_STC_STYLENEEDED to the appropriate function… Math lexer/parser 14 Years Ago by scru Is there an open source (lgpl, bsd, mit) math parser/lexer library available out there? Has anybody ever written one by themselves (with support for variables, exponents, grouping) and have some tips/hints? I get hard time when debugging this bug however this is the C++ life 15 Years Ago by NicAx64 … . so as other compiler related tools this also has a lexer , and use the flex opensource tool inside windows. So I…is a lex file that contains the rules for a lexer.and that file includes the Torkens.h that contains the….yy.c > preprocessed_only.pre I:\final-year-project-test\lexer> [/code] the character '>' will say the write std… STC_LEX_HTML doesn't fold 16 Years Ago by bibaso …HTML editor. Thats mean that i [B]changed the Lexer[/B], [B]put a keywords list [/B]and … rid off). The major problem is that the Lexer don't fold the text in the window,… the margin. and if i just change the lexer to STC_LEX_PYTHON, then it show the marks and …to change concern to folding, when i change Lexer I don't want to bother you people with… Problem with executing external apps 14 Years Ago by Szpilona Hi, I've created a lexer using flex. Now I want this lexer to be used in my C# application. I've…(); } } [/CODE] It works fine until the response from the lexer getting bigger than about 20KB. NO exception is thrown it… just gets stuck. Lexer, not executed from the app, even with much bigger … Dr Scheme problem about parse a list of symbols 17 Years Ago by xzhang …sym)) (define (uniOp? sym)) (define (checkEnding stack)) (define (lexer inpt)) (define (reduce stack); just let stack errors bomb! #f…cond ((null? stack) (write stack)(write inpt)(parse (cons (lexer inpt) stack) (cdr inpt))) ((eq? (car stack) '…write "\n")(parse (cons (lexer inpt) stack) (cdr inpt))))) ; notice the restriction … Compiling flex file into dll. 14 Years Ago by Szpilona Hi, I've got a lexer created with flex (under cygwin). Normally I compile it to …an .exe file. For the newest project I need a lexer to use in a bigger C# program running on Windows… I create a dll having the source code of the lexer? I've already tried to run flex on my grammar… lexers 15 Years Ago by srk619 need help on this question: Write a lexer to read in decimal numbers. If your input is the … a state transition diagram for the scanning part of your lexer. is this coding right: input = raw_input () # Grab raw keyboard input… Re: lexers 15 Years Ago by srk619 … it missing a line this was the question: Write a lexer to read in decimal numbers. Think hard about how to… a state transition diagram for the scanning part of your lexer. flex , how to lex a '>' character 14 Years Ago by NicAx64 I am using the lexer software independently without using the yacc parser. what I want … to use this '>' character how should I tell the lexer to do this ? [code] '\<' { InsertOperator ( ANGLE_OPEN) ; } '\>' { InsertOperator ( ANGLE_CLOSE… Parsing Implementation - Algebra Parsing Advice? 10 Years Ago by Aarowaim … understanding is that I need two pieces; a lexer, and a parser. The lexer is the piece that reads character by character… Re: Need Help combining programs into one 16 Years Ago by Aia …, fgetc might return EOF */ src = fopen("lexer.asm","r"); /* open lexer.asm for reading, what if can't… Re: lexers 15 Years Ago by srk619 this is the string you have to write in a lexer to read in decimal numbers “12345.9876” Re: lexers 15 Years Ago by shadwickman … afterwards [/code] So what exactly do you mean by 'a lexer to read decimal numbers'? As in floats (numbers with a… Re: lexers 15 Years Ago by srk619 can some plz show me or give me an example of how to write this lexer Re: What does this mean? (Code Snip) 13 Years Ago by digitig … 2006-12-28. Refresh occasionally from lexer." This stuff is all machine generated. The lexer knows those keywords, so they're… Re: What does this mean? (Code Snip) 13 Years Ago by zachattack05 … is performed when that keyword is used is generated by Lexer, and not the programmer? I guess what I mean is… example above), the code that is executed is generated by Lexer, not the programmer that created the COMMANDS array? Though I… Re: Generate and compile C/C++ code? 10 Years Ago by phorce … to defeat the object here. I guess the scripting language/lexer is written in C++? If so, shouldn't therefore the… lexer decide how the code is interpreted? I have no idea … Re: Parsing Implementation - Algebra Parsing Advice? 10 Years Ago by ddanbe …/217185/console-calculator-part-1-the-scanner) for the scanner(lexer). Hope it helps a bit. Re: Parsing Implementation - Algebra Parsing Advice? 10 Years Ago by gusano79 Definitely keep the lexer/parser concept; it makes things much easier to deal with. … Who can? 16 Years Ago by Heeyriss Who can help me with this programming assignment about the token stream, character stream, source stream. And even tokenizer program? Please help me with this lexer program.. Thanks in advance... Re: Who can? 16 Years Ago by Heeyriss about the lexer program that I'm doing right now, I need to check the argc,argv if they are right..