[Refactor] Add structured inference server config objects#3893

vmoens wants to merge 4 commits into

gh/vmoens/288/basepytorch/rl:gh/vmoens/288/basefrom

gh/vmoens/288/headpytorch/rl:gh/vmoens/288/headCopy head branch name to clipboard