Need to parse large conf files

JaredBusch

@matteo-nunziati said in Need to parse large conf files:

ok my last s**t, just in case @JaredBusch doesn't know what to do waiting for @Pete-S
still not granted to get only valid exten

doens't work right on a live file. close. but not correct.

JaredBusch

@JaredBusch said in Need to parse large conf files:

// find matching files, put in array called filename
$filename:=glob("*.ini");

it doesn't like the :

I moved a copy of the files to the FreePBX 14 box since PHP 5.6 is "current" for CentOS.

[jbusch@cccfreepbx newton_conf]$ sudo -u asterisk php parseit.php 
PHP Parse error:  syntax error, unexpected ':' in /var/www/html/newton_conf/parseit.php on line 3

1337

@JaredBusch

Hang on a sec. I'm just about finished.

1337

This is the output:

File: sample.conf
[context_1]
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
;;   Bob's inbound 3145551212                      ;
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
exten => 3145551212,1,NoOp()
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
;;  Mary's inbound 4534535345                      ;
;   With some added comments                       ;
exten => 4534535345,1,NoOp()
[context_2]
exten => 33333333,1,NoOp()
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
;;   What is this????????????                      ;
;    Lets add a long comment section               ;
exten => 3145454,1,NoOp()
;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
;;  Let's make a wonky comment line here
;   And lets add this too                         ;;
exten => 232342,1,NoOp()
[context_3]
exten => 7777777,1
exten => 8888888,1,NoOp()

Personally I'd format it a little for instance by remove all comment lines that are just ;;;;;; and all trailing and preceding ;

Or if it's just for viewing I'd html it.

1337

This is the complete php file with comments.

It takes all *.conf files and goes through them.

<?php

   // find matching files, put in array called filename
   $filename=glob("*.conf");
   

   // scan through all the files
   foreach ($filename as $f) {
      // print filename
      print "File: $f\n";

      // read all lines into lines array
      $lines=file($f);

      $no=0; // linenumber
      $comment=[]; // comments array

      // go through the file and pick out what we need
      foreach ($lines as $line) {
         $no++;

         // look for [context]
         if ($line[0]=='[') {
            $context=$line;
            print "$context";
         }
         
         // look for extensions
         $search="exten =>";
         if (substr($line,0,strlen($search))==$search) {
            //print $line;

            // we found the extension row
            // lets take everything after "exten =>"
            $extline=trim(substr($line,strlen($search)));

            // lets divide it up
            $parts=explode(',', $extline);
            $ext=$parts[0]; // extension number

            // check that it's ?????,1,?????
            if ($parts[1]=='1') {
               // valid extension, actual extension is $parts[0];
               $ext=$line;
               // print comments
               foreach($comment as $c) print "$c";
               // print the extesion and empty line
               print "$ext";
            }
            $comments=[]; // clear comments
         }
         
         // look for comments
         if ($line[0]==';') {
            // add to comments but only first 3 lines
            if (count($comment)<3) $comment[]=$line;
            //print_r($comment);
         } else {

            // non empty line? => clear comments
            if (trim($line)>'') $comment=[];

         }
      }
   }

?>

1337

@JaredBusch said in Need to parse large conf files:

@JaredBusch said in Need to parse large conf files:

// find matching files, put in array called filename
$filename:=glob("*.ini");

it doesn't like the :

I moved a copy of the files to the FreePBX 14 box since PHP 5.6 is "current" for CentOS.

It's because I've been working with another language all day that uses := to assign a variable and not just =

Takes me a few minutes to reboot my brain into php mode. :smiling_face_with_smiling_eyes:

1337

Just for fun I found some extensions.conf file on the net to try. It led me to add some better formatting so the output is more readable.

PS. Just a small change like this that would have caused hours of search on regex, options for grep, awk, sed etc to try and make something work. That's why I think it's easier to just go full on programming language as soon as it is more complex than just finding a few lines that matches.

I know as this is all for naught but whatever.

Output from the php script:

File: sample.conf

[context_1]
; Bob's inbound 3145551212
exten => 3145551212,1,NoOp()

; Mary's inbound 4534535345
; With some added comments
exten => 4534535345,1,NoOp()

[context_2]
exten => 33333333,1,NoOp()

; What is this????????????
; Lets add a long comment section
; Line 3,,,
exten => 3145454,1,NoOp()

; Let's make a wonky comment line here
; And lets add this too
exten => 232342,1,NoOp()

[context_3]
exten => 7777777,1

exten => 8888888,1,NoOp()

PHP script v2

<?php
   // Ver 2 - improved formatting, only showing headings that have extensions
   
   // find matching files, put in array called filename
   $filename=glob("*.conf");
   

   // scan through all the files
   foreach ($filename as $f) {
      // print filename
      print "File: $f\n\n";

      // read all lines into lines array
      $lines=file($f);

      $no=0; // linenumber
      $comment=[]; // comments array
      $context=''; // context text

      // go through the file and pick out what we need
      foreach ($lines as $line) {
         $no++;

         // look for [context]
         if ($line[0]=='[') {
            $context=trim($line);
         }
         
         // look for extensions
         $search="exten =>";
         if (substr($line,0,strlen($search))==$search) {
            //print $line;

            // we found the extension row
            // lets take everything after "exten =>"
            $extline=trim(substr($line,strlen($search)));

            // lets divide it up
            $parts=explode(',', $extline);

            // check that it's ?????,1,?????
            if ($parts[1]=='1') {
               // valid extension, actual extension is $parts[0];
               $ext=trim($line);
               
               // print context if it has not been printed
               if ($context>'') { print "$context\n"; $context=''; }
               // print comments
               foreach($comment as $c) print "; $c\n";
               // print the extension and empty line
               print "$ext\n\n";
            }
            $comments=[]; // clear comments
         }
         
         // look for comments
         if ($line[0]==';') {
            // remove whitespace and ;
            $s=trim($line,"; \t\n\r\0\x0B");
            // add to comments if not empty but only first 3 lines
            if (($s>'') and (count($comment)<3)) $comment[]=$s;
         } else {

            // non empty line? => clear comments
            if (trim($line)>'') $comment=[];

         }
      }
   }


?>

JaredBusch

@Pete-S this all hit as I was commuting home.

I have a copy of the files on a server I have access to from home and will be working on this tomorrow.

Thanks.

JaredBusch

@Pete-S Well tomorrow becamse the following Wednesday.. But. this works perfectly.

Now to figure out WTF all this stuff is that I need to replicate into FreePBX.

1337

@JaredBusch Glad it worked as intended.

Solved Need to parse large conf files