How should I setup IPs of three replicas and one client machine?

[jeffreyflukman]

I'm not a RCS@Columbia team, so how should I replace the need of 3 replica machines and one client machine?

I tried to use the ubuntu@u1 IP, and create two IP aliases, but it doesn't work.

When I tried to execute

./new-run.sh configs/apache.sh no_build joint_sched 1

I got this error :

/home/jeff/Programs/crane/eval-container
/home/jeff/Programs/crane/eval-container
The plan to run is: joint_sched
ssh_exchange_identification: read: Connection reset by peer
lost connection
Permission denied (publickey).
lost connection
ssh: connect to host bug02.cs.columbia.edu port 22: Connection refused
lost connection
ssh: connect to host bug02.cs.columbia.edu port 22: Connection refused
lost connection
running httpd with config joint_sched for 1 rounds...
this is round 1
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
ERROR: ld.so: object '/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object '/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
apr_socket_recv: Connection refused (111)
ERROR: ld.so: object '/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object '/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
apr_socket_recv: Connection refused (111)
Replaying parameters:
app : httpd
proxy : 1
xtern : 1
joint : 1 1
leader election : 0
checkpoint : 0
checkpoint_period : 10
MSMR_ROOT : /home/jeff/Programs/crane
build project : false
Killing residual processes

Removing temporaries

Starting proxy only or starting server only: yes no
replaying server master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h head "~/worker-run.py -a httpd -x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m s -i 0 --sp 1 --sd 1 --scmd 'rm /home/jeff/Programs/crane/apps/apache/install/logs/*; /home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f /home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start ' --tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only yes --start_server_only no"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker1 "~/worker-run.py -a httpd -x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 1 --sp 1 --sd 1 --scmd 'rm /home/jeff/Programs/crane/apps/apache/install/logs/*; /home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f /home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start ' --tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only yes --start_server_only no"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker2 "~/worker-run.py -a httpd -x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 2 --sp 1 --sd 1 --scmd 'rm /home/jeff/Programs/crane/apps/apache/install/logs/*; /home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f /home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start ' --tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only yes --start_server_only no"

Starting proxy only or starting server only: no yes
replaying server master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h head "~/worker-run.py -a httpd -x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m s -i 0 --sp 1 --sd 1 --scmd 'rm /home/jeff/Programs/crane/apps/apache/install/logs/*; /home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f /home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start ' --tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only no --start_server_only yes"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker1 "~/worker-run.py -a httpd -x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 1 --sp 1 --sd 1 --scmd 'rm /home/jeff/Programs/crane/apps/apache/install/logs/*; /home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f /home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start ' --tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only no --start_server_only yes"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker2 "~/worker-run.py -a httpd -x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 2 --sp 1 --sd 1 --scmd 'rm /home/jeff/Programs/crane/apps/apache/install/logs/*; /home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f /home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start ' --tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only no --start_server_only yes"

Deployment Done! Wait 10s for the servers to become stable!!!
Client starts apache benchmark. This is round 0.
Preload client library
client cmd reply : /home/jeff/Programs/crane/apps/apache/install/bin/ab -n 1000 -c 8 http://10.0.3.111:9000/test.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 10.0.3.111 (be patient)

Client workload done. Please grab performance result. Wait 20 seconds before exit.
Client starts apache benchmark. This is round 1.
Preload client library
client cmd reply : /home/jeff/Programs/crane/apps/apache/install/bin/ab -n 1000 -c 8 http://10.0.3.111:9000/test.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeust^[[1;2BERROR: ld.so: object '/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object '/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
apr_socket_recv: Connection refused (111)
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
ech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 10.0.3.111 (be patient)

Client workload done. Please grab performance result. Wait 20 seconds before exit.
Client starts apache benchmark. This is round 2.
Preload client library
client cmd reply : /home/jeff/Programs/crane/apps/apache/install/bin/ab -n 1000 -c 8 http://10.0.3.111:9000/test.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 10.0.3.111 (be patient)

Client workload done. Please grab performance result. Wait 20 seconds before exit.
Wait for 180s to kill all the processes
Killing residual processes

Removing temporaries

[hemingcui]

Hi Jef,
We have a script to re-config the IP. You could find the step in our
readme. Thanks.

https://github.com/columbia/crane/blob/master/README.md

Config the IPs of three replicas and one client machine. The default IPs
are already set for the RCS@Columbia team, so if you are in this team,
you don't need to run this command. You will need three replica machines to
host servers, and one client machine. For instance, in our Crane project,
our client machine is 128.59.21.11, three replicas: (128.59.17.174 (head),
128.59.17.172, 128.59.17.173). If your machine IPs are not this setting,
please run these same commands on all the replica (server) machines:

cd $MSMR_ROOT/eval-container ./update-replica-IPs.sh "

For instance, we ran this same command (including the order of IPs) on
128.59.17.174, 128.59.17.172, 128.59.17.173.

./update-replica-IPs.sh 128.59.17.174 128.59.17.172 128.59.17.173

On Fri, Nov 6, 2015 at 1:17 PM, Jeffrey F. Lukman notifications@github.com
wrote:

I'm not a RCS@Columbia team, so how should I replace the need of 3
replica machines and one client machine?

I tried to use the ubuntu@u1 IP, and create two IP aliases, but it
doesn't work.

When I tried to execute

./new-run.sh configs/apache.sh no_build joint_sched 1

I got this error :

/home/jeff/Programs/crane/eval-container
/home/jeff/Programs/crane/eval-container
The plan to run is: joint_sched
ssh_exchange_identification: read: Connection reset by peer
lost connection
Permission denied (publickey).
lost connection
ssh: connect to host bug02.cs.columbia.edu port 22: Connection refused
lost connection
ssh: connect to host bug02.cs.columbia.edu port 22: Connection refused
lost connection
running httpd with config joint_sched for 1 rounds...
this is round 1
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
ERROR: ld.so: object
'/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so'
from LD_PRELOAD cannot be preloaded (cannot open shared object file):
ignored.
ERROR: ld.so: object
'/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so'
from LD_PRELOAD cannot be preloaded (cannot open shared object file):
ignored.
apr_socket_recv: Connection refused (111)
ERROR: ld.so: object
'/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so'
from LD_PRELOAD cannot be preloaded (cannot open shared object file):
ignored.
ERROR: ld.so: object
'/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so'
from LD_PRELOAD cannot be preloaded (cannot open shared object file):
ignored.
apr_socket_recv: Connection refused (111)
Replaying parameters:
app : httpd
proxy : 1
xtern : 1
joint : 1 1
leader election : 0
checkpoint : 0
checkpoint_period : 10
MSMR_ROOT : /home/jeff/Programs/crane
build project : false
Killing residual processes

Removing temporaries

Starting proxy only or starting server only: yes no
replaying server master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h head "~/worker-run.py -a httpd -x
1 -p 1 -k 0 -c /home/jeff/Programs/crane -m s -i 0 --sp 1 --sd 1 --scmd 'rm
/home/jeff/Programs/crane/apps/apache/install/logs/*;
/home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f
/home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start '
--tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only yes
--start_server_only no"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker1 "~/worker-run.py -a httpd
-x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 1 --sp 1 --sd 1 --scmd
'rm /home/jeff/Programs/crane/apps/apache/install/logs/*;
/home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f
/home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start '
--tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only yes
--start_server_only no"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker2 "~/worker-run.py -a httpd
-x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 2 --sp 1 --sd 1 --scmd
'rm /home/jeff/Programs/crane/apps/apache/install/logs/*;
/home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f
/home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start '
--tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only yes
--start_server_only no"

Starting proxy only or starting server only: no yes
replaying server master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h head "~/worker-run.py -a httpd -x
1 -p 1 -k 0 -c /home/jeff/Programs/crane -m s -i 0 --sp 1 --sd 1 --scmd 'rm
/home/jeff/Programs/crane/apps/apache/install/logs/*;
/home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f
/home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start '
--tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only no
--start_server_only yes"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker1 "~/worker-run.py -a httpd
-x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 1 --sp 1 --sd 1 --scmd
'rm /home/jeff/Programs/crane/apps/apache/install/logs/*;
/home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f
/home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start '
--tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only no
--start_server_only yes"

Master: replaying master node command:
parallel-ssh -l jeff -v -p 1 -i -t 25 -h worker2 "~/worker-run.py -a httpd
-x 1 -p 1 -k 0 -c /home/jeff/Programs/crane -m r -i 2 --sp 1 --sd 1 --scmd
'rm /home/jeff/Programs/crane/apps/apache/install/logs/*;
/home/jeff/Programs/crane/apps/apache/install/bin/apachectl -f
/home/jeff/Programs/crane/apps/apache/install/conf/httpd.conf -k start '
--tool none --enable-lxc yes --dmt-log-output 0 --start_proxy_only no
--start_server_only yes"

Deployment Done! Wait 10s for the servers to become stable!!!
Client starts apache benchmark. This is round 0.
Preload client library
client cmd reply : /home/jeff/Programs/crane/apps/apache/install/bin/ab -n
1000 -c 8 http://10.0.3.111:9000/test.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 10.0.3.111 (be patient)

Client workload done. Please grab performance result. Wait 20 seconds
before exit.
Client starts apache benchmark. This is round 1.
Preload client library
client cmd reply : /home/jeff/Programs/crane/apps/apache/install/bin/ab -n
1000 -c 8 http://10.0.3.111:9000/test.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd,
http://www.zeust^[[1;2BERROR: ld.so: object
'/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so'
from LD_PRELOAD cannot be preloaded (cannot open shared object file):
ignored.
ERROR: ld.so: object
'/home/jeff/Programs/crane/libevent_paxos/client-ld-preload/libclilib.so'
from LD_PRELOAD cannot be preloaded (cannot open shared object file):
ignored.
apr_socket_recv: Connection refused (111)
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
/bin/sh: 1: parallel-ssh: not found
ech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 10.0.3.111 (be patient)

Client workload done. Please grab performance result. Wait 20 seconds
before exit.
Client starts apache benchmark. This is round 2.
Preload client library
client cmd reply : /home/jeff/Programs/crane/apps/apache/install/bin/ab -n
1000 -c 8 http://10.0.3.111:9000/test.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 10.0.3.111 (be patient)

Client workload done. Please grab performance result. Wait 20 seconds
before exit.
Wait for 180s to kill all the processes
Killing residual processes

Removing temporaries

—
Reply to this email directly or view it on GitHub
#5.

[jeffreyflukman]

I've tried that, but it also doesn't work.
The error is similar.

Do I need to clean up something first before I re-execute this code?

./new-run.sh configs/apache.sh no_build joint_sched 1

[hemingcui]

Hi Jef,
I recommend you open the re-config script to see what it does. I think
the reason you couldn't run this script is probably some environment
variables are not set properly. The re-config script is actually quite
simple, just replace some IP in texts. We have tried this script several
times. You can even manually do this if you want. :)

On Fri, Nov 6, 2015 at 1:37 PM, Jeffrey F. Lukman notifications@github.com
wrote:

I've tried that, but it also doesn't work.
The error is similar.

Do I need to clean up something first before I re-execute
'''
./new-run.sh configs/apache.sh no_build joint_sched 1
'''

—
Reply to this email directly or view it on GitHub
#5 (comment).