补充conductor命令

28 Oct 2025

目标/任务: 查看com/netbric/s5/conductor/handler/S5RestfulHandler.java，看看还有什么命令，如果pfccli没有实现，思考应该怎么实现

补充conductor命令1

任务1: 新增list_port

S5RestfulHandler.java 这是一个服务接口，用于后端可以操作volume/shard/replica等

尝试增加新接口’list_post’ 在CliMian文件里添加以下代码

static void cmd_list_port(Namespace cmd, Config cfg) throws Exception {
		// ListNodePortReply r = SimpleHttpRpc.invokeConductor(cfg, "list_port", "192.168.61.143", ListNodePortReply.class);
		ListNodePortReply r = SimpleHttpRpc.invokeConductor(cfg, "list_port", ListNodePortReply.class);
		if(r.retCode == RetCode.OK)
		logger.info("Succeed list_port");
		else
			throw new IOException(String.format("Failed to list_port , code:%d, reason:%s", r.retCode, r.reason));
		String [] header = { "IP Address", "Store Id", "Status"};

		String[][] data = new String[r.Ports.size()][];
		for(int i=0;i<r.Ports.size();i++) {
			data[i] = new String[]{ r.Ports.get(i).ip_addr, Long.toString(r.Ports.get(i).store_id), r.Ports.get(i).status };
		}
		ASCIITable.getInstance().printTable(header, data);
	}

发现需要增加对于的java类ListNodePortReply /home/flyslice/yangxiao/cocalele/jconductor/src/com/netbric/s5/conductor/rpc/ListNodePortReply.java

package com.netbric.s5.conductor.rpc;

import com.netbric.s5.orm.Port;

import java.util.List;

public class ListNodePortReply extends RestfulReply {

    public List<Port> Ports;
    

    public ListNodePortReply(String op) {
        super(op);
    }

    public ListNodePortReply(String op, int retCode, String reason) {
        super(op, retCode, reason);
    }
    public ListNodePortReply(String op, List<Port> Ports) {
        super(op);
        this.Ports = Ports;
    }
}

目前这样的修改，编译可以通过

ant -f jconductor.xml

251015-image1 但是运行结果还有问题(10.15待解决):

root@node2:/home/flyslice/yangxiao/cocalele/jconductor# ./pfcli list_port
[main] ERROR com.netbric.s5.conductor.rpc.SimpleHttpRpc - Failed http GET http://192.168.61.229:49180/s5c/?op=list_port
java.io.IOException: Failed RPC invoke, code:2, reason:Invalid argument: node_name
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeGET(SimpleHttpRpc.java:60)
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeConductor(SimpleHttpRpc.java:90)
	at com.netbric.s5.cli.CliMain.cmd_list_port(CliMain.java:357)
	at com.netbric.s5.cli.CliMain$4.run(CliMain.java:134)
	at com.netbric.s5.cli.CliMain.main(CliMain.java:211)
[main] ERROR com.netbric.s5.cli.CliMain - Failed: Failed RPC invoke, code:2, reason:Invalid argument: node_name

解决思路: 增加node_name参数

ListNodePortReply r = SimpleHttpRpc.invokeConductor(cfg, "list_port", ListNodePortReply.class,
						"node_name", "192.168.61.143");

然后发现这里原本serve端的代码jconductor/src/com/netbric/s5/conductor/handler/StoreHandler.java中是查询node_name, 但目前环境上没有配, 所以尝试改成id(也可以改成ip, 但id是唯一标识机器的, 用id更加准确)

251015-image2

MariaDB [s5]> select * from t_store;
+----+------+------+-------+----------------+--------+
| id | name | sn   | model | mngt_ip        | status |
+----+------+------+-------+----------------+--------+
|  1 | NULL | NULL | NULL  | 192.168.61.229 | OK     |
|  2 | NULL | NULL | NULL  | 192.168.61.143 | OK     |
|  3 | NULL | NULL | NULL  | 192.168.61.122 | OK     |
+----+------+------+-------+----------------+--------+

增加id参数

String id = cmd.getString("i");
ListNodePortReply r = SimpleHttpRpc.invokeConductor(cfg, "list_port", ListNodePortReply.class,
                      "id", id);

对于cli参数
```
./pfcli list_port -i 1
```

发现修改serve jconductor/src/com/netbric/s5/conductor/handler/StoreHandler.java文件内容没有生效，怀疑是因为这个是pfc服务，应该重启pfconductor服务才能生效 - 尝试重启pfconductor serve端仍然报错 | 报错如下:

root@node2:/home/flyslice/yangxiao/cocalele/jconductor# ./pfcli list_port
[main] ERROR com.netbric.s5.conductor.rpc.SimpleHttpRpc - Failed http GET http://192.168.61.229:49180/s5c/?op=list_port&id=1
java.io.IOException: Failed RPC invoke, code:2, reason:Invalid argument: node_name
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeGET(SimpleHttpRpc.java:60)
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeConductor(SimpleHttpRpc.java:90)
	at com.netbric.s5.cli.CliMain.cmd_list_port(CliMain.java:357)
	at com.netbric.s5.cli.CliMain$4.run(CliMain.java:134)
	at com.netbric.s5.cli.CliMain.main(CliMain.java:211)
[main] ERROR com.netbric.s5.cli.CliMain - Failed: Failed RPC invoke, code:2, reason:Invalid argument: node_name

启动 pfconductor

source /home/flyslice/yangxiao/cocalele/jconductor/env-pfc.sh
nohup pfc -c /etc/pureflash/pfc.conf &

目前问题: 这个pfcli报错一直是这个[main] ERROR com.netbric.s5.cli.CliMain - Failed: Failed RPC invoke, code:2, reason:Invalid argument: node_name，但是我修改了代码里面唯一有包含字段”Invalid argument: node_name”的地方重新编译报错一直不变，找不到他是从哪里出来的;其实报错也可以看到执行的http命令已修改为传递id(因为climain里面修改了)，但看起来后端serve对于的地方还是没有修改。

问题原因：没有在leader conductor服务器上修改

更新serve端步骤:

更新后端代码并重新编译
kill掉三台服务器上的conductor serve进程
重新启动serve，现在229上执行，因为默认只有一个主leader，最先执行服务的是leader，若kill掉leader上的进程默认会跳到别的服务器
- 想要一直保持229作为主节点需要三台同时以上操作

例如如下操作:

root@node2:/home/flyslice/yangxiao/cocalele/jconductor# ps -ef | grep pfc
root     1168411 1128129  0 15:44 pts/0    00:00:01 java -classpath /home/flyslice/yangxiao/cocalele/jconductor/out/production/jconductor:/home/flyslice/yangxiao/cocalele/jconductor/lib/* -Dorg.slf4j.simpleLogger.showDateTime=true -Dorg.slf4j.simpleLogger.dateTimeFormat=[yyyy/MM/dd H:mm:ss.SSS] -XX:+HeapDumpOnOutOfMemoryError com.netbric.s5.conductor.Main -c /etc/pureflash/pfc.conf
root     1168483 1128129  0 15:59 pts/0    00:00:00 grep --color=auto pfc
kill 1168411

# 启动pfconductor:三个节点上分别执行
source /home/flyslice/yangxiao/cocalele/jconductor/env-pfc.sh
nohup pfc -c /etc/pureflash/pfc.conf &

更新到229后生效，出现新问题

(2025.10.16)

flyslice@node1:~/yangxiao/cocalele/jconductor$ ./pfcli list_port -i 1
cmd_list_port
[main] ERROR com.netbric.s5.conductor.rpc.SimpleHttpRpc - Failed http GET http://192.168.61.229:49180/s5c/?op=list_port&id=1
java.io.IOException: Failed RPC invoke, code:4, reason:Cannot run program "c:/eclipse/plink.exe" (in directory "."): error=2, 没有那个文件或目录
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeGET(SimpleHttpRpc.java:60)
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeConductor(SimpleHttpRpc.java:90)
	at com.netbric.s5.cli.CliMain.cmd_list_port(CliMain.java:359)
	at com.netbric.s5.cli.CliMain$4.run(CliMain.java:135)
	at com.netbric.s5.cli.CliMain.main(CliMain.java:212)
[main] ERROR com.netbric.s5.cli.CliMain - Failed: Failed RPC invoke, code:4, reason:Cannot run program "c:/eclipse/plink.exe" (in directory "."): error=2, 没有那个文件或目录

修改src/com/netbric/s5/conductor/SshExec.java下的ssh路径

// static String ssh_bin = "c:/eclipse/plink.exe";
static String ssh_bin = "ssh"; ///home/flyslice/yangxiao/cocalele/jconductor/res/plink.exe
static Map<String, String> env = new HashMap<String, String>();
...

报错如下：

root@node1:/home/flyslice/yangxiao/cocalele/jconductor# ./pfcli list_port -i 1
cmd_list_port
id:1
[main] ERROR com.netbric.s5.conductor.rpc.SimpleHttpRpc - Failed http GET http://192.168.61.229:49180/s5c/?op=list_port&id=1
java.io.IOException: Failed RPC invoke, code:5, reason:Bad port 'w'

	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeGET(SimpleHttpRpc.java:60)
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeConductor(SimpleHttpRpc.java:90)
	at com.netbric.s5.cli.CliMain.cmd_list_port(CliMain.java:360)
	at com.netbric.s5.cli.CliMain$4.run(CliMain.java:135)
	at com.netbric.s5.cli.CliMain.main(CliMain.java:212)
[main] ERROR com.netbric.s5.cli.CliMain - Failed: Failed RPC invoke, code:5, reason:Bad port 'w'

目前卡住不知道在哪里** - 原因是ssh参数错误策略：重新下载一个虚拟机模拟环境测试。先放弃这个case，尝试别的case

客户端调用路径

CliMain.main() → CliMain$4.run() → CliMain.cmd_list_port() → SimpleHttpRpc.invokeConductor() → SimpleHttpRpc.invokeGET()

251029: 引入StoreHandler，可以不用自己创建一个新的相关reply，都已经定义了
更新修改如下
CliMain:

import com.netbric.s5.conductor.handler.StoreHandler.*;

sp=sps.addParser("list_port");
sp.description("List port info");
sp.addArgument("-i").help("Node Id name to check the port").required(true).metavar("node_id");
sp.addArgument("-p").help("port to check the port").required(true).metavar("port_id");
sp.setDefault("__func", new CmdRunner() {
	@Override
	public void run(Namespace cmd, Config cfg) throws Exception {
		cmd_list_port(cmd, cfg);
	}
});

static void cmd_list_port(Namespace cmd, Config cfg) throws Exception {
	System.out.println("cmd_list_port");
	String id = cmd.getString("i");
	String port = cmd.getString("p");
	System.out.println("id:" + id + ", port: " + port);
	ListNodePortReply r = SimpleHttpRpc.invokeConductor(cfg, "list_port", ListNodePortReply.class,
					"id", id, "port", port);
	if(r.retCode == RetCode.OK)
	logger.info("Succeed list_port");
	else
		throw new IOException(String.format("Failed to list_port , code:%d, reason:%s", r.retCode, r.reason));
	String [] header = { "IP Address", "Store Id", "Status"};

	// String[][] data = new String[r.ports.size()][];
	// for(int i=0;i<r.ports.size();i++) {
	// 	data[i] = new String[]{ r.ports.get(i).ip_addr, Long.toString(r.ports.get(i).store_id), r.ports.get(i).status };
	// }
	// ASCIITable.getInstance().printTable(header, data);
	String[][] data = new String[r.ports.length][];
	for (int i = 0; i < r.ports.length; i++) {
		data[i] = new String[]{ 
			r.ports[i].ip_addr, 
			Long.toString(r.ports[i].store_id), 
			r.ports[i].status 
		};
	}
	ASCIITable.getInstance().printTable(header, data);
}

对应serve端目前改动： StoreHandler:

/* 这里原本已经定义了 ListNodePortReply 
 因此可以直接使用 */
public static class ListNodePortReply extends RestfulReply
  {
      public Port[] ports;
      public ListNodePortReply(String op)
      {
          super(op);
      }
  }
public RestfulReply list_nodeport(Request request, Response response)
{
  String op = request.getParameter("op");
  String hostid = request.getParameter("id"); //改成了id，原本是hostname
  System.out.println("list_nodeport:" + hostid);
  if (StringUtils.isEmpty(hostid))
      return new RestfulReply(op, RetCode.INVALID_ARG, "Invalid argument: id");
  try
  {
      StoreNode node = S5Database.getInstance().where("id=?", hostid).first(StoreNode.class);  //改成了id，原本查找name
      ...
  }
}

ssh修改, SshExec:

// static String ssh_bin = "c:/eclipse/plink.exe";
static String ssh_bin = "ssh"; ///home/flyslice/yangxiao/cocalele/jconductor/res/plink.exe
...

251030 问题更新

发现Bad port 'w'问题出处：直接执行ssh可以发现

root@node1:~# ssh root@192.168.61.229 -pw Flysl1ce
Bad port 'w'

因此是参数-pw的问题

查看SshExec定义execute方法可得

CommandLine cl = new CommandLine(ssh_bin);
	cl.addArgument("-T");
	// cl.addArgument("-n"); //use ssh
	cl.addArgument("-pw"); // plink
	// cl.addArgument("123456"); // plink
	cl.addArgument("Flysl1ce");
	cl.addArgument("-l");
	cl.addArgument("root");
// 这里原本定义的是根据plink - Windows上用ssh方法 -需要改成ssh对应参数

这里找到”Bad port w”的错误原因了，是ssh不支持加了参数-pw导致的因为他这里用的是plink，我前面改成了ssh，但是ssh没办法直接登录，所以在系统上下载一个plink就可以了

251030-image2

此时遇到新错误

root@node1:/home/flyslice/yangxiao/cocalele/jconductor# ./pfcli list_port -i 1
cmd_list_port
id:1
[main] ERROR com.netbric.s5.conductor.rpc.SimpleHttpRpc - Failed http GET http://192.168.61.229:49180/s5c/?op=list_port&id=1
java.io.IOException: Failed RPC invoke, code:5, reason:bash: 行 1: source /etc/profile; echo : 没有那个文件或目录

	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeGET(SimpleHttpRpc.java:60)
	at com.netbric.s5.conductor.rpc.SimpleHttpRpc.invokeConductor(SimpleHttpRpc.java:90)
	at com.netbric.s5.cli.CliMain.cmd_list_port(CliMain.java:510)
	at com.netbric.s5.cli.CliMain$4.run(CliMain.java:141)
	at com.netbric.s5.cli.CliMain.main(CliMain.java:272)
[main] ERROR com.netbric.s5.cli.CliMain - Failed: Failed RPC invoke, code:5, reason:bash: 行 1: source /etc/profile; echo : 没有那个文件或目录

发现修改addArgument的参数(CommandLine接口)可以恢复命令问题

// cl.addArgument(remoteCmd);
cl.addArgument(remoteCmd, false);  // 取消自动分配的双引号，禁止自动添加引号

注：ssh需要事先存key，不然会报错

The server's host key is not cached. You have no guarantee that the server is the computer you think it is. The server's ssh-ed25519 key fingerprint is: ssh-ed25519 255 SHA256:xMa0mYxFZ3SyZPFyaPLbBR+K9bNHMQhr8dIK5EpnG0o If you trust this host, enter "y" to add the key to PuTTY's cache and carry on connecting. If you want to carry on connecting just once, without adding the key to the cache, enter "n". If you do not trust this host, press Return to abandon the connection. Store key in cache? (y/n, Return cancels connection, i for more info) Connection abandoned.

plink -pw Flysl1ce -l root 192.168.61.229
plink -pw Flysl1ce -l root 192.168.61.122
plink -pw flyslice -l root 192.168.61.143

最终效果(成功返回值)

目前只支持在本机上连自己获得这个信息，连别的会卡住

效果如下：

251031-image1

目前在229服务器上仅支持./pfcli list_port -i 1

日志(含调试打印信息)

251031-image2

最终代码

/* CliMain.java */

static void cmd_list_port(Namespace cmd, Config cfg) throws Exception {
	System.out.println("cmd_list_port");
	String id = cmd.getString("i");
	System.out.println("id:" + id);
	ListNodePortReply r = SimpleHttpRpc.invokeConductor(cfg, "list_port", ListNodePortReply.class,
					"id", id);
	if(r.retCode == RetCode.OK)
	logger.info("Succeed list_port");
	else
		throw new IOException(String.format("Failed to list_port , code:%d, reason:%s", r.retCode, r.reason));
	String [] header = { "Name", "IP Address", "Store Id", "Purpose"}; // "Status", 

	// String[][] data = new String[r.ports.size()][];
	// for(int i=0;i<r.ports.size();i++) {
	// 	data[i] = new String[]{ r.ports.get(i).ip_addr, Long.toString(r.ports.get(i).store_id), r.ports.get(i).status };
	// }
	// ASCIITable.getInstance().printTable(header, data);
	String[][] data = new String[r.ports.length][];
	for (int i = 0; i < r.ports.length; i++) {
		data[i] = new String[]{ 
			r.ports[i].name, 
			r.ports[i].ip_addr, 
			Long.toString(r.ports[i].store_id), 
			Long.toString(r.ports[i].purpose), 
			// r.ports[i].status 
		};
	}
	ASCIITable.getInstance().printTable(header, data);
}

src/com/netbric/s5/conductor/handler/StoreHandler.java更新见: storevolume-update.txt