I followed the steps for the installation procedure (https://berkeleyflow.readthedocs.io/en/latest/flow_setup.html). However, when i tried to run the example ( in the "Testing the Installation" section) I get the following error:

Traceback (most recent call last): File "examples/sumo/sugiyama.py", line 11, in from flow.envs.loop.loop_accel import AccelEnv, ADDITIONAL_ENV_PARAMS File "/home/dkoutras/flow/flow/envs/init.py", line 4, in from flow.envs.multiagent_env import MultiEnv File "/home/dkoutras/flow/flow/envs/multiagent_env.py", line 10, in from ray.rllib.env import MultiAgentEnv ModuleNotFoundError: No module named 'ray'

I have not installed the ray library, but as mentioned in the corresponding section I sould not need it anyway. Any ideas ?

Choose an option This is a:

• [x] Question
• [x] Feature request

Describe the issue Figure eight scenario only accommodates a maximum of 14 vehicles in Flow. Even if I give more than this, it is not effective. But I am planning to extend this to 100 vehicles involving RL and human vehicles. I just want to know the reason behind this limitation to be able to apply in a real world scenario. Can I add another route with this and expand the capacity_ Like merging one figure eight and one ring wave scenario or merging two figure eight scenarios to increase its capacity.

Expected behavior Many vehicles in a single road track

Desktop (please complete the following information):

• OS: Ubuntu 18.04
• Version [run python -c "import flow; print(flow.version)"]: Leave empty if not applicable.

Additional context https://flow.readthedocs.io/en/latest/examples.html#figure-eight

#Bug Description

ValueError: ('Observation outside expected value range', Box(339,), array([0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0.05 , 0.05 , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0.37301541, 0.42857143, 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 2. , 3. , 3. , 0. , 0. , 3. , 3. , 0. , 3. , 0. , 0. , 1. , 1. , 0. , 1. , 1. , 1. , 0. , 1. , 0. , 0. , 1. , 1. , 0. , 0. , 1. , 0. ]))

Bug Reproduce

/examples/rllib/traffic_light_grid.py

The exact command that you did run that caused the bug: python traffic_light_grid.py

Output Log

Traceback (most recent call last): File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/tune/trial_runner.py", line 498, in _process_trial result = self.trial_executor.fetch_result(trial) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/tune/ray_trial_executor.py", line 342, in fetch_result result = ray.get(trial_future[0]) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/worker.py", line 2247, in get raise value ray.exceptions.RayTaskError: ray_PPO:train() (pid=10958, host=611dabai) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/agents/trainer.py", line 369, in train raise e File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/agents/trainer.py", line 358, in train result = Trainable.train(self) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/tune/trainable.py", line 171, in train result = self._train() File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/agents/trainer_template.py", line 126, in _train fetches = self.optimizer.step() File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/optimizers/multi_gpu_optimizer.py", line 140, in step self.num_envs_per_worker, self.train_batch_size) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/optimizers/rollout.py", line 29, in collect_samples next_sample = ray_get_and_free(fut_sample) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/utils/memory.py", line 33, in ray_get_and_free result = ray.get(object_ids) ray.exceptions.RayTaskError: ray_RolloutWorker:sample() (pid=11185, host=611dabai) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/evaluation/rollout_worker.py", line 453, in sample batches = [self.input_reader.next()] File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/evaluation/sampler.py", line 56, in next batches = [self.get_data()] File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/evaluation/sampler.py", line 97, in get_data item = next(self.rollout_provider) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/evaluation/sampler.py", line 313, in _env_runner soft_horizon) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/evaluation/sampler.py", line 401, in _process_observations policy_id).transform(raw_obs) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/models/preprocessors.py", line 166, in transform self.check_shape(observation) File "/home/dl_e/anaconda3/envs/flow_backup/lib/python3.6/site-packages/ray/rllib/models/preprocessors.py", line 61, in check_shape self._obs_space, observation) ValueError: ('Observation outside expected value range', Box(339,), array([0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0.05 , 0.05 , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0.37301541, 0.42857143, 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 0. , 2. , 3. , 3. , 0. , 0. , 3. , 3. , 0. , 3. , 0. , 0. , 1. , 1. , 0. , 1. , 1. , 1. , 0. , 1. , 0. , 0. , 1. , 1. , 0. , 0. , 1. , 0. ]))

Versions

• OS: ubuntu 16.04
• Flow version: 0.5.0.dev
• Flow commit number: fatal: there is no submission

Hi, I don't know what happend but I am having trouble with flow right now. What use to work doesn't anymore. I 'm going to try to find out about that error but if anyone knows.

Warning: Cannot find local schema '/Users/username/flow/bin/data/xsd/types_file.xsd', will try website lookup.```

Numpy=1.13.0 leads to some crazy looking error. This is extremely high priority, I will confirm that it passes on my machine and @AboudyKreidieh can you try it on your machine and confirm this works?

Choose an option This is a:

• [x] Question

Describe the issue When coming to the Installing Flow and SUMO, after downloading SUMO’s github directory, something goes wrong and I cannot figure it out.

I input the code into terminal export CPPFLAGS=-I/opt/X11/include export LDFLAGS=-L/opt/X11/lib ./configure CXX=clang++ CXXFLAGS="-stdlib=libc++ -std=gnu++11" --with-xerces=/usr/local --with-proj-gdal=/usr/local make -j$nproc But I got MacBook-Pro-3:sumo mac$ make -j$nproc make: *** No targets specified and no makefile found. Stop. I have tried many times and dont know why

Pull request information

• Status: In development
• Kind of changes: File and class names of environments/scenarios, structure of example folders
• Related PR or issue: #564

Description

This PR introduces major changes to file names and folder structures, as well as fo some class names, mainly for the following folders:

• envs
• multiagent_envs (now is a subfolder under envs)
• scenarios
• examples
• removal of cooperative_merge (and loop_merge)

TODO:

• [x] better names for environments --> NL
• [x] merge multiagent_envs into envs --> AY
• [x] better name for scenarios so that they match the environments --> AY
• [x] better file names (e.g. sugiyama, loop,ring -> ring) --> AY, NL

This is how the new envs folder looks like (some classes names have also been changed):

envs
├── __init__.py
├── base.py
├── bay_bridge.py
├── bottleneck.py
├── merge.py
├── multiagent
│   ├── __init__.py
│   ├── base.py
│   ├── highway.py
│   ├── ring
│   │   ├── __init__.py
│   │   ├── accel.py
│   │   └── wave_attenuation.py
│   └── traffic_light_grid.py
├── ring
│   ├── __init__.py
│   ├── accel.py
│   ├── lane_change_accel.py
│   └── wave_attenuation.py
├── test.py
└── traffic_light_grid.py

This is how the new scenarios folder looks like (some classes names have also been changed):

scenarios/
├── __init__.py
├── base.py
├── bay_bridge.py
├── bay_bridge_toll.py
├── bottleneck.py
├── figure_eight.py
├── highway.py
├── merge.py
├── minicity.py
├── multi_ring.py
├── ring.py
└── traffic_light_grid.py

[QUESTION] Hello! I am trying to create a simple grid scenario containing at the same time actuated traffic lights and a group of RL-based traffic lights. I am modifying the following scripts:

• flow/examples/rllib/green_wave.py (Experiment)
• flow/scenatios/grid.py (Scenario)
• flow/envs/green_wave_env.py (Environment)

According to the ADDITIONAL_ENV_PARAMS variable, either all traffic lights are "controlled" (RL) or either they are all actuated. I've tried to add every TL manually in the grid scenario but it seems that in the end the ADDITIONAL_ENV_PARAMS variable is who determines how traffic lights are managed in the simulation. Is there a way I could do this? I didn't find any documentation about it.

Thank you very much!

Antonio

The conflict is caused by: The user requested redis~=2.10.6 ray 0.8.0 depends on redis>=3.3.2

To fix this you could try to:

1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

Pip subprocess error: ERROR: Cannot install -r /Users/dulei/Documents/Flow/flow/condaenv.k_4i73t0.requirements.txt (line 18) and redis~=2.10.6 because these package versions have conflicting dependencies. ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies

failed

CondaEnvException: Pip failed

Sorry for the problem again, I solved the problem yesterday and made sugiyama.py run correctly. However, when I rerun the sugiyama.py today, I got another problem saying "No module named traci". I'm sure I activate the source flow. Also I find the 'traci' direptory locally.

Versions: Ubuntu 16.04 Python 3.5

Problem: The following error codes occur after running examples/sumo/sugiyama.py

Loading configuration... done. Success. Error: On processing option '--num-clients': No option with the name 'num-clients' exists. Error: The parameter '1' is not allowed in this context. Switch or parameter name expected. Error: On processing option '--collision.check-junctions': No option with the name 'collision.check-junctions' exists. Error: The parameter 'true' is not allowed in this context. Switch or parameter name expected. Error: Could not parse commandline options. Quitting (on error). Could not connect to TraCI server at localhost:51587 [Errno 111] Connection refused Retrying in 1 seconds Could not connect to TraCI server at localhost:51587 [Errno 111] Connection refused

The sumo gui pops up with the above error codes. Flow had already been activated with 'source activate flow.' Any help would be appreciated.

Thanks!

Bumps tensorflow from 1.15.2 to 2.9.3.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Bug Description

It is impossible to create an environment or install the proper dependencies for Flow to work, with the current environment.yml and requirements.txt. This is because the dependencies are mostly outdated and have conflicts, which need to be resolved during installation.

I personally had a hard time before I could actually get Flow to work on my Ubuntu 18.04 machine, so I'm posting the changes that MIGHT work for you as well (this totally depends on your machine as I have not tested it on any other OS).

environment.yml:

name: flow

dependencies:
    - python==3.7.3
    - pip:
        - scipy==1.1.0
        - lxml==4.4.1
        - six==1.11.0
        - path.py
        - python-dateutil==2.7.3
        - pip>=18.0
        - tensorflow==1.15.2
        - setuptools==41.0.0
        - plotly==2.4.0
        - gym==0.14.0
        - pyprind==2.11.2
        - nose2==0.8.0
        - cached_property
        - joblib==0.10.3
        - matplotlib==3.0.0
        - dill
        - lz4
        - ray==0.8.0
        - setproctitle
        - psutil
        - opencv-python
        - boto3==1.10.45
        - redis

requirements.txt

gym==0.14.0
numpy==1.18.4
scipy==1.1.0
lxml==4.4.1
pyprind==2.11.2
nose2==0.8.0
six==1.11.0
path.py
joblib==0.10.3
python-dateutil==2.7.3
cached_property
pyglet==1.3.2
matplotlib==3.1.0
imutils==0.5.1
numpydoc
ray==0.8.0
opencv-python
dill
lz4
setproctitle
psutil
opencv-python
boto3==1.10.45
redis
pandas==0.24.2
plotly==2.4.0
tabulate
tensorflow==1.15.2
awscli==1.16.309
torch==1.4.0
pytz
tensorboardX

If you still have some dependency issues, just make sure that you remove the versions from the above files and allow pip to resolve any conflicts. Another tip is to uninstall and reinstall packages if they throw ImportError, ModuleNotFoundError etc.

Also, any help regarding how to install Flow on Windows would be greatly appreciated.

Bumps joblib from 0.10.3 to 1.2.0.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

I am using Flow to start a SUMO simulation integrating deep reinforcement learning inside the process. I am also using another computer to retrieve some data from the simulation using TraCI.

The first problem is that flow does not assign the port I choose correctly. Secondly, the other computer connects to the SUMO simulation using TraCI, but as soon as it starts it goes out and doesn't save anything. The simulation keeps going on on the other computer.

• THIS IS THE CODE I USE ON THE FIRST COMPUTER TO ASSIGN THE PORT AND THE CLIENTS FOR SUMO

sim_params = SumoParams(port=45678, render=VISUALIZE_SIM_IN_SUMO, sim_step=1, num_clients=2)

• THIS IS THE CODE I USE ON THE SECOND COMPUTER TO CONNECT WITH TRACI AND RETRIEVE DATA

PORT = 49745 ( I need to set it once I start the simulation on the first computer since Flow does not use the port I specified at the beginning)

traci.init(PORT,tc.DEFAULT_NUM_RETRIES,"second_computer.local") traci.setOrder(2) # number can be anything as long as each client gets its number

If this solution is not achievable, do you know how to get this data from another terminal ?

Bumps lxml from 4.4.1 to 4.9.1.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Bumps numpy from 1.18.4 to 1.22.0.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.