/Users/andy/dev/ohcount/src/parser_macros.h File Reference

#include <stdio.h>
#include <stdlib.h>
#include "languages.h"

Go to the source code of this file.

Data Structures

struct  CallbackItem
 Holds a series of callbacks for in a queue (linked list). More...

Defines

#define dequeue
#define ls
#define code
#define comment
#define saw(lang)
#define std_internal_newline(lang)
#define emb_internal_newline(lang)
#define std_newline(lang)
#define emb_newline(lang)
#define process_last_line(lang)
#define check_blank_entry(lang)
#define NEWLINE   -1
#define INTERNAL_NL   -2
#define CHECK_BLANK_ENTRY   -3
#define cint(c)   ((int) (c - buffer_start))
#define init

Typedefs

typedef struct CallbackItem Callback

Functions

void enqueue (const char *lang, const char *entity, int s, int e, void *udata)
void free_queue ()
int is_blank_entry (char **p)

Variables

Callback * callback_list_head = NULL
Callback * callback_list_tail = NULL
int cs
int act
char * p
char * pe
char * eof
char * ts
char * te
int stack [5]
int top
char * buffer_start
int whole_line_comment
int line_contains_code
char * line_start
int entity
const char * seen
int inqueue
char * last_line_start
int last_line_contains_code
int last_whole_line_comment

Define Documentation

#define CHECK_BLANK_ENTRY   -3

Check blank entry entity. Used for embedded language transitions. If a newline follows immediately after such a transition, the line should be counted as parent code, not child code.

Note:
This is only used for line counting parsers.

#define check_blank_entry ( lang   ) 

Value:

{ \
  if (is_blank_entry(&p)) { \
    te = p + 1; \
    std_newline(lang) \
  } \
}
If there is a transition into an embedded language and there is only parent language code on the line (the rest of the line is blank with no child code), count the line as a line of parent code. Moves p and te to the end of the newline and calls the std_newline macro. (p is inclusive, te is not.) This is typically used in the main action for the CHECK_BLANK_ENTRY entity.
Parameters:
lang The language name string.
Note:
Applies only to line counting parsers.

#define cint ( c   )     ((int) (c - buffer_start))

Returns the absolute location in memory for a position relative to the start of the buffer being parsed.

Parameters:
c Position relative to the start of the buffer.
Note:
This is only used for line counting parsers.

#define code

Value:

{ \
  if (inqueue) { dequeue; } \
  if (!line_contains_code && !line_start) line_start = ts; \
  line_contains_code = 1; \
}
The C equivalent of the Ragel 'code' action. This is tyically used in the main action for entities where Ragel actions cannot, for one reason or another, be used.
Note:
Applies only to line counting parsers.

#define comment

Value:

{ \
  if (inqueue) { dequeue; } \
  if (!line_contains_code) { \
    whole_line_comment = 1; \
    if (!line_start) line_start = ts; \
  } \
}
The C equivalent of the Ragel 'comment' action. This is typically unused, but here for consistency.
Note:
Applies only to line counting parsers.

#define dequeue

Value:

{ \
  inqueue = 0; \
  line_start = last_line_start; \
  line_contains_code = last_line_contains_code; \
  whole_line_comment = last_whole_line_comment; \
}
Restores settings for a failed enqueued entity. This is typically used in the ls, code, and comment macros.
Note:
Applies only to line counting parsers.

#define emb_internal_newline ( lang   ) 

Value:

{ \
  if (seen && seen != lang) \
    std_internal_newline(seen) \
  else \
    std_internal_newline(lang) \
  seen = 0; \
}
Executes emebedded language line counting actions for INTERNAL_NL entities based on whether or not the embedded language's code has been seen in a parent line. This is typically used in the main action for the INTERNAL_NL entity.
Parameters:
lang The language name string.
Note:
Applies only to line counting parsers.

#define emb_newline ( lang   ) 

Value:

{ \
  if (seen && seen != lang) \
    std_newline(seen) \
  else \
    std_newline(lang) \
  seen = 0; \
}
Executes embedded language line counting actions for NEWLINE entities based on whether or not the embedded language's code has been seen in a parent line. This is typically used in the main action for the NEWLINE entity.
Parameters:
lang The language name string.
Note:
Applies only to line counting parsers.

#define init

Value:

{ \
  p = buffer; \
  pe = buffer + length; \
  eof = pe; \
  \
  buffer_start = buffer; \
  whole_line_comment = 0; \
  line_contains_code = 0; \
  line_start = 0; \
  entity = 0; \
  seen = 0; \
  inqueue = 0; \
}
Initializes variables for parsing a buffer. Required at the beginning of every parser function.

#define INTERNAL_NL   -2

Internal newline entity. Used for newlines inside patterns like strings and comments that can have newlines in them.

Note:
This is only used for line counting parsers.

#define ls

Value:

{ \
  if (inqueue) { dequeue; } \
  if (!line_start) line_start = ts; \
}
Sets the line_start variable to ts. This is typically used for the SPACE entity in the main action.
Note:
Applies only to line counting parsers.

#define NEWLINE   -1

Newline entity.

Note:
This is only used for line counting parsers.

#define process_last_line ( lang   ) 

Value:

{\
  if ((whole_line_comment || line_contains_code) && callback) { \
    if (line_contains_code) \
      callback(lang, "lcode", cint(line_start), cint(pe), userdata); \
    else if (whole_line_comment) \
      callback(lang, "lcomment", cint(line_start), cint(pe), userdata); \
  } \
}
Processes the last line for buffers that don't have a newline at EOF. This is typically used at the end of the parse_lang function after the Ragel parser has been executed.
Parameters:
lang The language name string.
Note:
Applies only to line counting parsers.

#define saw ( lang   ) 

Value:

{ \
  seen = lang; \
  whole_line_comment = 0; \
  line_contains_code = 0; \
}
Sets up for having seen an embedded language. This is typically used when entering an embedded language which usually does not span multiple lines (e.g. php for <?php echo 'blah' ?> on single lines) so the line is counted as embedded code or comment, not parent code.
Parameters:
lang The language name string.
Note:
Applies only to line counting parsers.

#define std_internal_newline ( lang   ) 

Value:

{ \
  if (callback && p > line_start) { \
    if (line_contains_code) { \
      if (inqueue) \
        enqueue(lang, "lcode", cint(line_start), cint(p), userdata); \
      else \
        callback(lang, "lcode", cint(line_start), cint(p), userdata); \
    } else if (whole_line_comment) { \
      if (inqueue) \
        enqueue(lang, "lcomment", cint(line_start), cint(p), userdata); \
      else \
        callback(lang, "lcomment", cint(line_start), cint(p), userdata); \
    } else { \
      if (inqueue) \
        enqueue(lang, "lblank", cint(line_start), cint(p), userdata); \
      else \
        callback(lang, "lblank", cint(line_start), cint(p), userdata); \
    } \
  } \
  whole_line_comment = 0; \
  line_contains_code = 0; \
  line_start = p; \
}
Executes standard line counting actions for INTERNAL_NL entities. This is typically used in the main action for the INTERNAL_NL entity.
Parameters:
lang The language name string.
Note:
Applies only to line counting parsers.

#define std_newline ( lang   ) 

Value:

{\
  if (inqueue) { dequeue; } \
  if (callback && te > line_start) { \
    if (line_contains_code) \
      callback(lang, "lcode", cint(line_start), cint(te), userdata); \
    else if (whole_line_comment) \
      callback(lang, "lcomment", cint(line_start), cint(te), userdata); \
    else \
      callback(lang, "lblank", cint(ts), cint(te), userdata); \
  } \
  whole_line_comment = 0; \
  line_contains_code = 0; \
  line_start = 0; \
}
Executes standard line counting actions for NEWLINE entities. This is typically used in the main action for the NEWLINE entity.
Parameters:
lang The language name string.
Note:
Applies only to line counting parsers.

Typedef Documentation

typedef struct CallbackItem Callback

Function Documentation

void enqueue ( const char *  lang,
const char *  entity,
int  s,
int  e,
void *  udata 
)

Enqueues a callback for calling upon commit. This is only necessary for line counting machines. Ragel will execute actions in real-time rather than after a complete match. This is a problem for entities that contain internal newlines, since there is a callback for each internal newline whether or not the end of the entity matches. This means that if, for example, the beginning of a string entity is matched, the text following is treated as code until the ending delimiter. If there is no ending delimiter (it was not actually a string entity), Ragel will jump back to the beginning of the string and reparse the text again. This means all the callbacks called were probably not accurate. To remedy this, any entity which needs an ending delimiter that may not appear will have its callbacks enqueued and then committed when the ending delimitter is reached. If that delimitter is not reached, the callbacks are never called.

Parameters:
lang The language name.
entity The entity (lcode, lcomment, lblank).
s The start position of the entity in the buffer.
e The end position of the entity in the buffer.
udata Userdata.

void free_queue (  ) 

Frees the memory used by a queue.

int is_blank_entry ( char **  p  ) 

Determines whether or not the rest of the line is blank. This is typically used when entering an embedded language.

Parameters:
p The position of entry into the emebedded language.
Returns:
0 if the rest of the line is not blank, the position at the end of the newline otherwise (inclusive).
Note:
Applies only to line counting parsers.

Variable Documentation

int act

Required by Ragel.

char* buffer_start

The buffer currently being parsed.

Callback* callback_list_head = NULL

The head of the Callback queue.

Callback* callback_list_tail = NULL

The tail of the Callback queue.

int cs

Required by Ragel.

int entity

State variable for the current entity being matched.

char* eof

Required by Ragel.

int inqueue

Flag indicating whether or not to enqueue callbacks instead of calling them in real time.

Note:
This is only used for line counting parsers.

int last_line_contains_code

Backup variable for 'inqueue'ing.

Note:
This is only used for line counting parsers.

char* last_line_start

Backup variable for 'inqueue'ing.

Note:
This is only used for line counting parsers.

int last_whole_line_comment

Backup variable for 'inqueue'ing.

Note:
This is only used for line counting parsers.

int line_contains_code

Flag indicating whether or not the current line contains any code.

Note:
This is only used for line counting parsers.

char* line_start

The beginning of the current line in the buffer being parsed.

Note:
This is only used for line counting parsers.

char* p

Required by Ragel.

char* pe

Required by Ragel.

const char* seen

Keeps track of an embedded language.

Note:
This is only used for line counting parsers.

int stack[5]

Required by Ragel.

char* te

Required by Ragel.

int top

Required by Ragel.

char* ts

Required by Ragel.

int whole_line_comment

Flag indicating whether or not the current line contains only a comment.

Note:
This is only used for line counting parsers.

Generated on Fri Aug 28 15:20:08 2009 for ohcount by  doxygen 1.5.9