Method: HTMLTokenizer#getNextToken

Defined in:
lib/openid/yadis/htmltokenizer.rb

#getNextToken ⇒ Object

Get the next token, returns an instance of

  • HTMLText

  • HTMLToken

  • HTMLTag



103
104
105
106
107
108
109
110
111
112
113
 
# File 'lib/openid/yadis/htmltokenizer.rb', line 103

def getNextToken
  token = peekNextToken
  if token
    # @page = @page[token.raw.length .. -1]
    # @page.slice!(0, token.raw.length)
    @cur_pos += token.raw.length
  end
  #p token
  #print token.raw
  return token
end