hg/stx-goodies-petitparser: parsers/java/PPJavaTokenParser.st@e1c44b571db9 (annotated)

435 3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	1	"{ Package: 'stx:goodies/petitparser/parsers/java' }"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	2
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	3	"{ NameSpace: Smalltalk }"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	4
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	5	PPTokenParser subclass:#PPJavaTokenParser
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	6	instanceVariableNames:''
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	7	classVariableNames:''
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	8	poolDictionaries:''
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	9	category:'PetitJava-Core'
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	10	!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	11
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	12	!PPJavaTokenParser methodsFor:'parsing'!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	13
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	14	parseComments: anArray on: aStream
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	15
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	16	\| start comments \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	17	comments := anArray.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	18	[
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	19	\| peekTwice \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	20	[ aStream atEnd not and: [ aStream peek isSeparator ] ]
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	21	whileTrue: [ aStream next ].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	22	peekTwice := aStream peekTwice.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	23	((peekTwice first = $/) and:
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	24	[ (peekTwice second = $*) or: [peekTwice second = $/]])] whileTrue: [
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	25	"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	26	Transcript show: ('position ', aStream position asString, ' char ', aStream next asString); cr.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	27	"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	28	aStream next.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	29	start := aStream position.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	30	(aStream next = $*)
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	31	ifTrue: [ aStream upToAll: '*/' ]
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	32	ifFalse: [
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	33	\| position \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	34	position := aStream position.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	35	aStream upToAnyOf: CharacterSet crlf].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	36	comments := comments copyWith: (start to: aStream position) ].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	37	^ comments
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	38	!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	39
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	40	parseOn: aPPContext
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	41	\| token comments memento \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	42	memento := aPPContext remember.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	43	comments := self
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	44	parseComments: #()
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	45	on: aPPContext.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	46	token := super parseOn: aPPContext.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	47	token isPetitFailure ifTrue: [
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	48	aPPContext restore: memento.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	49	^ token ].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	50	comments := self
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	51	parseComments: comments
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	52	on: aPPContext.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	53	^ token comments: comments
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	54	! !
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	55
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	56	!PPJavaTokenParser methodsFor:'private'!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	57
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	58	defaultTokenClass
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	59	^ PPJavaToken
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	60	! !
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	61

author	Jan Vrany <jan.vrany@fit.cvut.cz>
	Tue, 21 Apr 2015 17:06:24 +0100
changeset 436	e1c44b571db9
parent 435	3bc08fb90133
child 439	1a7d51c92b9a
permissions	-rw-r--r--