hg/stx-goodies-petitparser: parsers/java/PPJavaTokenParser.st@3bc08fb90133 (annotated)

435 3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	1	"{ Package: 'stx:goodies/petitparser/parsers/java' }"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	2
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	3	"{ NameSpace: Smalltalk }"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	4
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	5	PPTokenParser subclass:#PPJavaTokenParser
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	6	instanceVariableNames:''
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	7	classVariableNames:''
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	8	poolDictionaries:''
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	9	category:'PetitJava-Core'
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	10	!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	11
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	12	PPJavaTokenParser comment:''
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	13	!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	14
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	15	!PPJavaTokenParser methodsFor:'parsing'!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	16
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	17	parseComments: anArray on: aStream
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	18
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	19	\| start comments \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	20	comments := anArray.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	21	[
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	22	\| peekTwice \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	23	[ aStream atEnd not and: [ aStream peek isSeparator ] ]
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	24	whileTrue: [ aStream next ].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	25	peekTwice := aStream peekTwice.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	26	((peekTwice first = $/) and:
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	27	[ (peekTwice second = $*) or: [peekTwice second = $/]])] whileTrue: [
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	28	"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	29	Transcript show: ('position ', aStream position asString, ' char ', aStream next asString); cr.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	30	"
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	31	aStream next.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	32	start := aStream position.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	33	(aStream next = $*)
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	34	ifTrue: [ aStream upToAll: '*/' ]
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	35	ifFalse: [
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	36	\| position \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	37	position := aStream position.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	38	aStream upToAnyOf: CharacterSet crlf].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	39	comments := comments copyWith: (start to: aStream position) ].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	40	^ comments
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	41	!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	42
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	43	parseOn: aPPContext
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	44	\| token comments memento \|
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	45	memento := aPPContext remember.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	46	comments := self
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	47	parseComments: #()
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	48	on: aPPContext.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	49	token := super parseOn: aPPContext.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	50	token isPetitFailure ifTrue: [
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	51	aPPContext restore: memento.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	52	^ token ].
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	53	comments := self
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	54	parseComments: comments
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	55	on: aPPContext.
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	56	^ token comments: comments
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	57	! !
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	58
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	59	!PPJavaTokenParser methodsFor:'private'!
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	60
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	61	defaultTokenClass
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	62	^ PPJavaToken
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	63	! !
3bc08fb90133 Initial commit of PetitJava Jan Vrany <jan.vrany@fit.cvut.cz> parents: diff changeset	64

author	Jan Vrany <jan.vrany@fit.cvut.cz>
	Tue, 21 Apr 2015 14:57:16 +0100
changeset 435	3bc08fb90133
child 436	e1c44b571db9
permissions	-rw-r--r--