如何将Newick树格式转换为树状分层对象?

时间:2018-07-17 04:37:09

标签: javascript python parsing tree logic

我想在Python中将Newick file转换为分层对象(类似于在this post中发布的对象)。

我的输入是一个Newick文件,如下所示:

(A:0.1,B:0.2,(C:0.3,D:0.4)E:0.5)F:0.9

原始帖子逐个字符地分析字符串。为了也存储分支长度,我修改了JavaScript文件(来自here),如下所示:

var newick = '// (A:0.1,B:0.2,(C:0.3,D:0.4)E:0.5)F:0.9',
    stack = [],
    child,
    root = [],
    node = root;

var na = "";
newick.split('').reverse().forEach(function(n) {
    switch(n) {
    case ')':
        // ')' => begin child node
        if (na != "") {
            node.push(child = { name: na });
            na = "";
        }
        stack.push(node);
        child.children = [];
        node = child.children;
        break;

    case '(':
        // '(' => end of child node
        if (na != "") {
            node.push(child = { name: na });
            na = "";
        }
        node = stack.pop();
        // console.log(node);
        break;

    case ',':
        // ',' => separator (ignored)
        if (na != "") {
            node.push(child = { name: na });
            na = "";
        }
        break;

    default:
        // assume all other characters are node names
        // node.push(child = { name: n });
        na += n;
        break;
    }
});

console.log(node);

现在,我想将此代码转换为Python。

这是我的尝试(我知道这是不正确的):

class Node:

  def __init__(self):
    self.Name = ""
    self.Value = 0
    self.Children = []

newick = "(A:0.1,B:0.2,(C:0.3,D:0.4)E:0.5,G:0.8)F:0.9"
stack = []
# root = []
# node = []

for i in list(reversed(newick)):
  if i == ')':
    if na != "":
      node = Node()
      node.Name = na
      child.append(node)
      na = ""
    stack.append(node)
    # insert logic
    child = node.Children
    # child.append(child)

  elif i == '(':
    if (na != ""):
      child = Node()
      child.Name = na
      node.append(child)
      na = ""
    node = stack.pop()
  elif i == ',':
    if (na != ""):
      node = Node()
      node.Name = na
      node.append(child)
      na = ""
  else:
    na += n

由于我是JavaScript的新手,因此无法将代码“转换”为Python。特别是,我不明白以下几行:

child.children = [];
node = child.children;

我该如何正确地用Python编写代码,同时提取长度?

3 个答案:

答案 0 :(得分:0)

以下代码可能不是javascript代码的确切翻译,但可以正常使用。有一些问题,例如“ n”尚未定义。我还将节点名称的解析添加到名称和值以及父字段中。

您应该考虑使用https://biopython.org/wiki/Phylo之类已经存在的解析器,因为它们已经为您提供了与树配合使用的基础结构和算法。

class Node:
    # Added parsing of the "na" variable to name and value.
    # Added a parent field
    def __init__(self, name_val):
        name, val_str = name_val[::-1].split(":")
        self.name = name
        self.value = float(val_str)
        self.children = []
        self.parent = None

    # Method to get the depth of the node (for printing)
    def get_depth(self):
        current_node = self
        depth = 0
        while current_node.parent:
            current_node = current_node.parent
            depth += 1
        return depth

    # String representation
    def __str__(self):
        return "{}:{}".format(self.name, self.value)

newick = "(A:0.1,B:0.2,(C:0.3,D:0.4)E:0.5,G:0.8)F:0.9"

root = None
# na was not defined before.
na = ""
stack = []
for i in list(reversed(newick)):
    if i == ')':
        if na != "":
            node = Node(na)
            na = ""
            if len(stack):
                stack[-1].children.append(node)
                node.parent = stack[-1]
            else:
                root = node
            stack.append(node)

    elif i == '(':
        if (na != ""):
            node = Node(na)
            na = ""
            stack[-1].children.append(node)
            node.parent = stack[-1]
        stack.pop()
    elif i == ',':
        if (na != ""):
            node = Node(na)
            na = ""
            stack[-1].children.append(node)
            node.parent = stack[-1]
    else:
        # n was not defined before, changed to i.
        na += i

# Just to print the parsed tree.
print_stack = [root]
while len(print_stack):
    node = print_stack.pop()
    print(" " * node.get_depth(), node)
    print_stack.extend(node.children)

最后一个打印位的输出如下:

 F:0.9
  A:0.1
  B:0.2
  E:0.5
   C:0.3
   D:0.4
  G:0.8

答案 1 :(得分:0)

有关JavaScript版本的一些评论:

  • 它具有一些易于避免的代码重复(if (na != '') ...)。
  • 它使用node作为数组的变量名。当您对数组(或Python中的列表)使用复数单词时,可读性得到了改善。
  • 它不会输出您想要的内容:它会输出名称类似于“ 9.0:F”的节点,而不是将长度与名称分隔开。

由于最后一点,在翻译成Python之前,首先需要更正代码。它应该支持拆分名称/长度属性,允许它们中的任一个都是可选的。此外,它可以为每个创建的节点分配id值,并添加一个parentid属性以引用节点的父节点。

我个人更喜欢使用递归编码而不是使用堆栈变量。另外,使用正则表达式API,您可以轻松地对输入进行标记化以促进解析:

Newick格式解析器的JavaScript版本

function parse(newick) {
    let nextid = 0;
    const regex = /([^:;,()\s]*)(?:\s*:\s*([\d.]+)\s*)?([,);])|(\S)/g;
    newick += ";"
    
    return (function recurse(parentid = -1) {
        const children = [];
        let name, length, delim, ch, all, id = nextid++;;

        [all, name, length, delim, ch] = regex.exec(newick);
        if (ch == "(") {
            while ("(,".includes(ch)) {
                [node, ch] = recurse(id);
                children.push(node);
            }
            [all, name, length, delim, ch] = regex.exec(newick);
        }
        return [{id, name, length: +length, parentid, children}, delim];
    })()[0];
}

// Example use:
console.log(parse("(A:0.1,B:0.2,(C:0.3,D:0.4)E:0.5,G:0.8)F:0.9"));
.as-console-wrapper { max-height: 100% !important; top: 0; }

Python版本的Newick格式解析器

import re

def parse(newick):
    tokens = re.findall(r"([^:;,()\s]*)(?:\s*:\s*([\d.]+)\s*)?([,);])|(\S)", newick+";")

    def recurse(nextid = 0, parentid = -1): # one node
        thisid = nextid;
        children = []

        name, length, delim, ch = tokens.pop(0)
        if ch == "(":
            while ch in "(,":
                node, ch, nextid = recurse(nextid+1, thisid)
                children.append(node)
            name, length, delim, ch = tokens.pop(0)
        return {"id": thisid, "name": name, "length": float(length) if length else None, 
                "parentid": parentid, "children": children}, delim, nextid

    return recurse()[0]

# Example use:
print(parse("(A:0.1,B:0.2,(C:0.3,D:0.4)E:0.5,G:0.8)F:0.9"))

关于JavaScript代码中的赋值node = child.children:这会将“指针”(即node)移至要创建的树中的更深一层,以便在算法的下一次迭代中新节点将添加到该级别。使用node = stack.pop(),指针将在树中向上追溯一级。

答案 2 :(得分:0)

这里是此输入字符串的pyparsing解析器。它使用pyparsing的nestedExpr解析器构建器,并带有已定义的content参数,以便将结果解析为键值对,而不仅仅是简单的字符串(默认值)。

import pyparsing as pp
# suppress punctuation literals from parsed output
pp.ParserElement.inlineLiteralsUsing(pp.Suppress)

ident = pp.Word(pp.alphas)
value = pp.pyparsing_common.real

element = pp.Group(ident + ':' + value)
parser = pp.OneOrMore(pp.nestedExpr(content=pp.delimitedList(element) + pp.Optional(','))
                      | pp.delimitedList(element))

tests = """
    (A:0.1,B:0.2,(C:0.3,D:0.4)E:0.5)F:0.9
"""
parsed_results = parser.parseString(tests)
import pprint
pprint.pprint(parsed_results.asList(), width=20)

礼物:

[[['A', 0.1],
  ['B', 0.2],
  [['C', 0.3],
   ['D', 0.4]],
  ['E', 0.5]],
 ['F', 0.9]]

请注意,用于解析实数的pyparsing表达式也可以将解析时转换为Python浮点数。