[yugabyted] Start takes a long time if yb-ctl cluster already running

[m-iancu]

Already had an RF1, yb-ctl cluster running locally -- took 4+ minutes to get the timeout error -- even longer for Shutting down... step to finish.

13:35 $ ./bin/yugabyted start
Starting YugabyteDB...
System checks ✅
Database installed ✅
Bringing up UI...Timed out trying to start yugabyted daemon.
For more information, check the logs in /Users/mihnea/myb/yugabyte-2.0.8.0/yugabyte-logs
13:39 $ Timeout: Failed to log into webserver. <urlopen error [Errno 61] Connection refused

[jaki]

I had an RF3 yb-ctl cluster running, and this took 00:03:57 and exited with code 1.

% ./yugabyted start
Starting YugabyteDB...
Running system checks...Timed out trying to start yugabyted daemon.
For more information, check the logs in /net/xxxx/share/yugabyte-2.0.8.0/yugabyte-logs
Failed to bind to address: 127.0.0.1:7100:
For more information, check the logs in /net/xxxx/share/yugabyte-2.0.8.0/yugabyte-logs
Shutting down...

[jaki]

Got the same failure again:

Starting YugabyteDB...
Running system checks...Timed out trying to start yugabyted daemon.
For more information, check the logs in /net/xxxx/share/yugabyte-2.0.8.0/yugabyte-logs

yugabyted.log:

[yugabyted:1685] 2019-12-20 13:50:29,947 INFO:  | 0.1s | Starting YugabyteDB...
[yugabyted:1685] 2019-12-20 13:50:29,947 INFO:  | 0.1s | Running the post-installation script /net/xxxx/share/yugabyte-2.0.8.0/bin/post_install.sh
[yugabyted:1685] 2019-12-20 13:50:29,955 INFO:  | 0.1s | Successfully ran the post-installation script.
[yugabyted:1685] 2019-12-20 13:50:29,957 INFO:  | 0.1s | Daemon grandchild process begins execution.
[yugabyted:1685] 2019-12-20 13:50:29,958 INFO:  | 0.1s | yugabyted started running with PID 15914.
[yugabyted:1685] 2019-12-20 13:50:29,959 INFO:  | 0.1s | Creating data directory /net/xxxx/share/yugabyte-2.0.8.0/yugabyte-data.
[yugabyted:1685] 2019-12-20 13:50:29,959 INFO:  | 0.1s | About to start master with cmd /net/xxxx/share/yugabyte-2.0.8.0/bin/yb-master --stop_on_parent_termination --undefok=stop_on_parent_termination --fs_data_dirs=/net/xxxx/share/yugabyte-2.0.8.0/yugabyte-data --webserver_interface=127.0.0.1 --metrics_snapshotter_tserver_metrics_whitelist=handler_latency_yb_tserver_TabletServerService_Read_count,handler_latency_yb_tserver_TabletServerService_Write_count,handler_latency_yb_tserver_TabletServerService_Read_sum,handler_latency_yb_tserver_TabletServerService_Write_sum,disk_usage,cpu_usage,node_up --yb_num_shards_per_tserver=1 --ysql_num_shards_per_tserver=1 --master_addresses=127.0.0.1:7100 --rpc_bind_addresses=127.0.0.1:7100 --server_broadcast_addresses=127.0.0.1:7100 --replication_factor=1 --use_initial_sys_catalog_snapshot --server_dump_info_path=/net/xxxx/share/yugabyte-2.0.8.0/yugabyte-data/master-info --master_enable_metrics_snapshotter=true --webserver_port=7000
[yugabyted:1685] 2019-12-20 13:50:29,962 INFO:  | 0.1s | master started running with PID 15915.
[yugabyted:1685] 2019-12-20 13:50:29,963 INFO:  | 0.1s | About to start tserver with cmd /net/xxxx/share/yugabyte-2.0.8.0/bin/yb-tserver --stop_on_parent_termination --undefok=stop_on_parent_termination --fs_data_dirs=/net/xxxx/share/yugabyte-2.0.8.0/yugabyte-data --webserver_interface=127.0.0.1 --metrics_snapshotter_tserver_metrics_whitelist=handler_latency_yb_tserver_TabletServerService_Read_count,handler_latency_yb_tserver_TabletServerService_Write_count,handler_latency_yb_tserver_TabletServerService_Read_sum,handler_latency_yb_tserver_TabletServerService_Write_sum,disk_usage,cpu_usage,node_up --yb_num_shards_per_tserver=1 --ysql_num_shards_per_tserver=1 --tserver_master_addrs=127.0.0.1:7100 --rpc_bind_addresses=127.0.0.1:9100 --server_broadcast_addresses=127.0.0.1:9100 --cql_proxy_bind_address=127.0.0.1:9042 --server_dump_info_path=/net/xxxx/share/yugabyte-2.0.8.0/yugabyte-data/tserver-info --start_pgsql_proxy --pgsql_proxy_bind_address=127.0.0.1:5433 --tserver_enable_metrics_snapshotter=true --metrics_snapshotter_interval_ms=11000 --webserver_port=9000
[yugabyted:1685] 2019-12-20 13:50:29,967 INFO:  | 0.1s | tserver started running with PID 15916.
[yugabyted:1685] 2019-12-20 13:50:29,968 INFO:  | 0.1s | Waiting for yb master via ybadmin...
[yugabyted:1685] 2019-12-20 13:53:30,053 ERROR:  | 180.2s | Timed out trying to start yugabyted daemon.
For more information, check the logs in /net/xxxx/share/yugabyte-2.0.8.0/yugabyte-logs
[yugabyted:1685] 2019-12-20 13:53:36,733 INFO:  | 186.9s | Failed waiting for yb master, current num tservers=None, expected 1.
[yugabyted:1685] 2019-12-20 13:53:36,733 ERROR:  | 186.9s | Failed to bind to address: 127.0.0.1:7100:
For more information, check the logs in /net/xxxx/share/yugabyte-2.0.8.0/yugabyte-logs
[yugabyted:1685] 2019-12-20 13:53:36,734 INFO:  | 186.9s | Shutting down...