Unicode16String.st
author Jan Vrany <jan.vrany@labware.com>
Thu, 25 Mar 2021 20:30:03 +0000
branchjv
changeset 25411 248600ba8fd9
parent 23547 c69c97cec351
permissions -rw-r--r--
Fix unlikely but possible race in `WeakValueDictionary` It may happen that value in `valueArray` could have been already collected by the GC but #clearDeadSlots have not yet been called. When this happened, `#at:ifAbsentPut:` returned tombstone rather than updating the dictionary with value from block. This commit fixes this by checking whether `valueArray` contain the tombstone and if so, clearing up the dead slots and restarting the operation. HTH.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
23547
c69c97cec351 Issue #239: Fix all Smalltak/X source files to be in unicode (UTF8 without BOM) and prefixed by "{ Encoding: utf8 }" when any unicode character is present
Patrik Svestka <patrik.svestka@gmail.com>
parents: 19948
diff changeset
     1
"{ Encoding: utf8 }"
c69c97cec351 Issue #239: Fix all Smalltak/X source files to be in unicode (UTF8 without BOM) and prefixed by "{ Encoding: utf8 }" when any unicode character is present
Patrik Svestka <patrik.svestka@gmail.com>
parents: 19948
diff changeset
     2
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
     3
"
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
     4
 COPYRIGHT (c) 1997 by eXept Software AG 
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
     5
	      All Rights Reserved
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
     6
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
     7
 This software is furnished under a license and may be used
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
     8
 only in accordance with the terms of that license and with the
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
     9
 inclusion of the above copyright notice.   This software may not
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    10
 be provided or otherwise made available to, or used by, any
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    11
 other person.  No title to or ownership of the software is
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    12
 hereby transferred.
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    13
"
10223
761e2a050b69 twoByteString moved (req'd in VM)
Claus Gittinger <cg@exept.de>
parents: 9648
diff changeset
    14
"{ Package: 'stx:libbasic' }"
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    15
17537
6ed63b021903 class: Unicode16String
Claus Gittinger <cg@exept.de>
parents: 17182
diff changeset
    16
"{ NameSpace: Smalltalk }"
6ed63b021903 class: Unicode16String
Claus Gittinger <cg@exept.de>
parents: 17182
diff changeset
    17
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    18
TwoByteString variableWordSubclass:#Unicode16String
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    19
	instanceVariableNames:''
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    20
	classVariableNames:''
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    21
	poolDictionaries:''
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    22
	category:'Collections-Text'
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    23
!
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    24
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    25
!Unicode16String class methodsFor:'documentation'!
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    26
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    27
copyright
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    28
"
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    29
 COPYRIGHT (c) 1997 by eXept Software AG 
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    30
	      All Rights Reserved
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    31
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    32
 This software is furnished under a license and may be used
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    33
 only in accordance with the terms of that license and with the
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    34
 inclusion of the above copyright notice.   This software may not
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    35
 be provided or otherwise made available to, or used by, any
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    36
 other person.  No title to or ownership of the software is
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    37
 hereby transferred.
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    38
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    39
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    40
"
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    41
!
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    42
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    43
documentation
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    44
"
10223
761e2a050b69 twoByteString moved (req'd in VM)
Claus Gittinger <cg@exept.de>
parents: 9648
diff changeset
    45
    Represents 16-bit (2-byte) Unicode strings.
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    46
"
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    47
! !
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    48
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    49
!Unicode16String class methodsFor:'initialization'!
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    50
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    51
initialize
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    52
    "initialize the class - private"
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    53
7949
421a3e216337 *** empty log message ***
Claus Gittinger <cg@exept.de>
parents: 7946
diff changeset
    54
    self flags:(Behavior flagWords).
421a3e216337 *** empty log message ***
Claus Gittinger <cg@exept.de>
parents: 7946
diff changeset
    55
421a3e216337 *** empty log message ***
Claus Gittinger <cg@exept.de>
parents: 7946
diff changeset
    56
    Smalltalk at:#UnicodeString put:Unicode16String.
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    57
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    58
    "
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    59
     Unicode16String initialize
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    60
    "
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    61
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    62
    "Created: 30.6.1997 / 15:35:52 / cg"
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    63
    "Modified: 30.6.1997 / 15:39:21 / cg"
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    64
! !
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    65
11323
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    66
!Unicode16String class methodsFor:'reading'!
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    67
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    68
readFrom:aStreamOrString onError:exceptionBlock
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    69
    "read & return the next String from the (character-)stream aStream;
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    70
     skipping all whitespace first; return the value of exceptionBlock,
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    71
     if no string can be read. The sequence of characters as read from the
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    72
     stream must be one as stored via storeOn: or storeString."
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    73
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    74
    "
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    75
     this method is not to be inherited
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    76
     (i.e. not ok for subclasses; Symbol, for example)
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    77
    "
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    78
    self ~~ Unicode16String ifTrue:[
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    79
        ^ super readFrom:aStreamOrString onError:exceptionBlock
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    80
    ].
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    81
    ^ self readSmalltalkStringFrom:aStreamOrString onError:exceptionBlock
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    82
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    83
    "
23547
c69c97cec351 Issue #239: Fix all Smalltak/X source files to be in unicode (UTF8 without BOM) and prefixed by "{ Encoding: utf8 }" when any unicode character is present
Patrik Svestka <patrik.svestka@gmail.com>
parents: 19948
diff changeset
    84
        self readFrom:'abcäöü' storeString
11323
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    85
    "
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    86
! !
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    87
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
    88
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    89
!Unicode16String methodsFor:'conversion'!
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    90
8294
ba5f4421848f Define #asUnicode16String and #asUnicode32String
Stefan Vogel <sv@exept.de>
parents: 8049
diff changeset
    91
asUnicode16String
8942
41d4d78ceb65 *** empty log message ***
Claus Gittinger <cg@exept.de>
parents: 8407
diff changeset
    92
    "as the receiver already is a unicode-16 string, return it"
41d4d78ceb65 *** empty log message ***
Claus Gittinger <cg@exept.de>
parents: 8407
diff changeset
    93
8294
ba5f4421848f Define #asUnicode16String and #asUnicode32String
Stefan Vogel <sv@exept.de>
parents: 8049
diff changeset
    94
    ^ self
ba5f4421848f Define #asUnicode16String and #asUnicode32String
Stefan Vogel <sv@exept.de>
parents: 8049
diff changeset
    95
!
ba5f4421848f Define #asUnicode16String and #asUnicode32String
Stefan Vogel <sv@exept.de>
parents: 8049
diff changeset
    96
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
    97
asUnicodeString
8942
41d4d78ceb65 *** empty log message ***
Claus Gittinger <cg@exept.de>
parents: 8407
diff changeset
    98
    "as the receiver already is a unicode string, return it"
41d4d78ceb65 *** empty log message ***
Claus Gittinger <cg@exept.de>
parents: 8407
diff changeset
    99
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   100
    ^ self
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   101
! !
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   102
8049
ccd0e8f26439 printing - migrating towards unicodeSupport in ST-code
Claus Gittinger <cg@exept.de>
parents: 7982
diff changeset
   103
!Unicode16String methodsFor:'printing & storing'!
ccd0e8f26439 printing - migrating towards unicodeSupport in ST-code
Claus Gittinger <cg@exept.de>
parents: 7982
diff changeset
   104
14121
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   105
displayOn:aGCOrStream
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   106
    "display myself as on aStream.
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   107
     You must use an ISO10646 unicode font to display this string"
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   108
17537
6ed63b021903 class: Unicode16String
Claus Gittinger <cg@exept.de>
parents: 17182
diff changeset
   109
    "/ what a kludge - Dolphin and Squeak mean: printOn: a stream;
6ed63b021903 class: Unicode16String
Claus Gittinger <cg@exept.de>
parents: 17182
diff changeset
   110
    "/ ST/X (and some old ST80's) mean: draw-yourself on a GC.
14558
b168e9f03911 class: Unicode16String
Stefan Vogel <sv@exept.de>
parents: 14124
diff changeset
   111
    aGCOrStream isStream ifTrue:[
14121
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   112
        aGCOrStream
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   113
            nextPut:$';
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   114
            nextPutAllUnicode:self;
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   115
            nextPut:$'.
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   116
        ^ self
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   117
    ].
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   118
    ^ super displayOn:aGCOrStream
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   119
!
fea92d19d1a4 added: #displayOn: (instead of #displaySting)
Stefan Vogel <sv@exept.de>
parents: 14075
diff changeset
   120
11323
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   121
printOn:aStream
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   122
    "print the receiver on aStream. 
13986
c8b952d6139c comment/format in: #printOn:
Claus Gittinger <cg@exept.de>
parents: 13737
diff changeset
   123
     Let aStream decide how to represent this, whether utf8, ucs16, ..."
11323
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   124
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   125
    aStream nextPutAllUnicode:self
13986
c8b952d6139c comment/format in: #printOn:
Claus Gittinger <cg@exept.de>
parents: 13737
diff changeset
   126
c8b952d6139c comment/format in: #printOn:
Claus Gittinger <cg@exept.de>
parents: 13737
diff changeset
   127
    "Modified (comment): / 25-01-2012 / 10:28:34 / cg"
11323
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   128
!
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   129
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   130
storeOn:aStream
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   131
    "put the storeString of myself on aStream"
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   132
18970
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   133
    self containsNon7BitAscii ifTrue:[
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   134
        "non-7bit string has been utf8Encoded"
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   135
        self utf8Encoded storeOn:aStream.
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   136
        aStream nextPutAll:' utf8Decoded'.
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   137
    ] ifFalse:[
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   138
        self asSingleByteString storeOn:aStream.
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   139
    ].
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   140
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   141
    "
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   142
        String streamContents:[:s|
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   143
            'hello' asUnicodeString storeOn:s
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   144
        ].
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   145
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   146
        String streamContents:[:s|
23547
c69c97cec351 Issue #239: Fix all Smalltak/X source files to be in unicode (UTF8 without BOM) and prefixed by "{ Encoding: utf8 }" when any unicode character is present
Patrik Svestka <patrik.svestka@gmail.com>
parents: 19948
diff changeset
   147
            'hello -öäüß' asUnicodeString storeOn:s
18970
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   148
        ].
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   149
    "
13737
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   150
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   151
"/    aStream nextPut:$'.
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   152
"/    (self includes:$') ifTrue:[
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   153
"/        self do:[:thisChar |
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   154
"/            (thisChar == $') ifTrue:[aStream nextPut:thisChar].
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   155
"/            aStream nextPutUnicode:thisChar
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   156
"/        ]
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   157
"/    ] ifFalse:[
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   158
"/        aStream nextPutAllUnicode:self
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   159
"/    ].
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   160
"/    aStream nextPut:$'
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   161
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   162
    "Modified: / 28-09-2011 / 16:17:38 / cg"
11323
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   163
!
c9ebe199a8fc Unicode handling:
Stefan Vogel <sv@exept.de>
parents: 11293
diff changeset
   164
8049
ccd0e8f26439 printing - migrating towards unicodeSupport in ST-code
Claus Gittinger <cg@exept.de>
parents: 7982
diff changeset
   165
storeString
ccd0e8f26439 printing - migrating towards unicodeSupport in ST-code
Claus Gittinger <cg@exept.de>
parents: 7982
diff changeset
   166
    "return a String for storing myself"
ccd0e8f26439 printing - migrating towards unicodeSupport in ST-code
Claus Gittinger <cg@exept.de>
parents: 7982
diff changeset
   167
18970
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   168
    self containsNon7BitAscii ifTrue:[
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   169
        "non-7bit string has been utf8Encoded"
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   170
        ^ (self utf8Encoded storeString),' utf8Decoded'.
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   171
    ] ifFalse:[
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   172
        ^ self asSingleByteString storeString.
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   173
    ].
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   174
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   175
    "
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   176
        'hello' asUnicodeString storeString
23547
c69c97cec351 Issue #239: Fix all Smalltak/X source files to be in unicode (UTF8 without BOM) and prefixed by "{ Encoding: utf8 }" when any unicode character is present
Patrik Svestka <patrik.svestka@gmail.com>
parents: 19948
diff changeset
   177
        'hello -öäüß' storeString
c69c97cec351 Issue #239: Fix all Smalltak/X source files to be in unicode (UTF8 without BOM) and prefixed by "{ Encoding: utf8 }" when any unicode character is present
Patrik Svestka <patrik.svestka@gmail.com>
parents: 19948
diff changeset
   178
        'hello -öäüß' asUnicodeString storeString
18970
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   179
    "
13737
0873cbb1365d unicode storestring fixed
Claus Gittinger <cg@exept.de>
parents: 11323
diff changeset
   180
13989
cd15b3b6154a backward compatibility storestring
Claus Gittinger <cg@exept.de>
parents: 13988
diff changeset
   181
    "Modified: / 25-01-2012 / 11:59:34 / cg"
14124
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   182
!
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   183
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   184
unicodeStoreOn:aStream
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   185
    "put the storeString of myself on aStream"
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   186
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   187
    aStream nextPut:$'.
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   188
    (self includes:$') ifTrue:[
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   189
        self do:[:thisChar |
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   190
            (thisChar == $') ifTrue:[aStream nextPut:thisChar].
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   191
            aStream nextPutUnicode:thisChar
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   192
        ]
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   193
    ] ifFalse:[
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   194
        aStream nextPutAllUnicode:self
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   195
    ].
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   196
    aStream nextPut:$'
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   197
!
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   198
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   199
unicodeStoreString
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   200
    "return a UnicodeString for storing myself.
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   201
     This method is a kind of kludge.
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   202
     Use it when you want to write a storeString to an encoded Stream"
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   203
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   204
    ^ self basicStoreString.
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   205
! !
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   206
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   207
!Unicode16String methodsFor:'testing'!
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   208
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   209
isUnicode16String
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   210
    ^ true
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   211
!
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   212
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   213
isUnicodeString
19937
48031fe6896b #DOCUMENTATION by cg
Claus Gittinger <cg@exept.de>
parents: 19218
diff changeset
   214
    "true if this is a 2- or 4-byte unicode string
48031fe6896b #DOCUMENTATION by cg
Claus Gittinger <cg@exept.de>
parents: 19218
diff changeset
   215
     (i.e. not a single byte string).
48031fe6896b #DOCUMENTATION by cg
Claus Gittinger <cg@exept.de>
parents: 19218
diff changeset
   216
     Notice, that the name is misleading: 
48031fe6896b #DOCUMENTATION by cg
Claus Gittinger <cg@exept.de>
parents: 19218
diff changeset
   217
     all strings are use unicode encoding"
48031fe6896b #DOCUMENTATION by cg
Claus Gittinger <cg@exept.de>
parents: 19218
diff changeset
   218
14124
Stefan Vogel <sv@exept.de>
parents: 14121
diff changeset
   219
    ^ true
8049
ccd0e8f26439 printing - migrating towards unicodeSupport in ST-code
Claus Gittinger <cg@exept.de>
parents: 7982
diff changeset
   220
! !
ccd0e8f26439 printing - migrating towards unicodeSupport in ST-code
Claus Gittinger <cg@exept.de>
parents: 7982
diff changeset
   221
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   222
!Unicode16String class methodsFor:'documentation'!
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   223
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   224
version
18970
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   225
    ^ '$Header$'
13988
81154d310967 use new c-escape string for stroreString
Claus Gittinger <cg@exept.de>
parents: 13986
diff changeset
   226
!
81154d310967 use new c-escape string for stroreString
Claus Gittinger <cg@exept.de>
parents: 13986
diff changeset
   227
81154d310967 use new c-escape string for stroreString
Claus Gittinger <cg@exept.de>
parents: 13986
diff changeset
   228
version_CVS
18970
f4c3afd137e3 #REFACTORING
Stefan Vogel <sv@exept.de>
parents: 17537
diff changeset
   229
    ^ '$Header$'
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   230
! !
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   231
14605
90d502689de9 class: Unicode16String
Stefan Vogel <sv@exept.de>
parents: 14558
diff changeset
   232
7946
469d2d1c61f1 initial checkin
Claus Gittinger <cg@exept.de>
parents:
diff changeset
   233
Unicode16String initialize!