January 2021 - LNST-developers - Fedora mailing-lists

[DISCUSSION] python version requirement
by Ondrej Lichtner 06 Apr '21

06 Apr '21

Hi all, since we've moved to python3 that is actively developed and versions move between various long term/short term support cycles, we should also adapt LNST to this cycle of updating which minimal version of python LNST requires. TL;DR: The main questions I'm asking are: * how do we _implement_ a python version requirement? * how do we _upgrade_/_migrate_ in the future? * how do we _document_ a python version requirement? * which version do we want to use _now_? More context: I think at the moment we have a "soft" requirement for python3.6. Soft because we: * probably haven't tested on anything older * it's not explicitly configured/documented anywhere At the same time, there are now at least two reasons to start thinking about moving to python3.8: * I remember Perry asking about the f-string feature introduced in 3.8 * while working with Adrian on the TRex refactoring I started thinking about a feature for the lnst.Tests package that I've had in mind for a while, which requires a 3.7 feature * python3.8 is the current version on Fedora32, is available in RHEL8 (via dnf install python38), and python3.7 was skipped The lnst.Tests feature I'm thinking of is "lazy" and "dynamic" loading of BaseTestModule derived modules - for example at the moment, if a Recipe imports any module from lnst.Tests (e.g. lnst.Tests.Ping), the entire package is parsed and "loaded", which means that the python environment will also parse and load lnst.Tests.TRex. This means that a basic hello world recipe that simply calls Ping, will in some way require load time dependencies of TRex. The "lazy" and "dynamic" loading of test modules would ensure that when a recipe calls: from lnst.Tests import Ping Only the Ping module will be parsed, loaded and imported, and nothing else. And the dynamicity here could mean that we could be able to extend test modules exported by the lnst.Tests package via the lnst-ctl config file, for example for user/tester implemented test modules that are not tracked in the main lnst repository. I wrote a rough patch to experiment with this: --- diff --git a/lnst/Tests/__init__.py b/lnst/Tests/__init__.py index f7c6c90..a39b6f4 100644 --- a/lnst/Tests/__init__.py +++ b/lnst/Tests/__init__.py @@ -12,8 +12,26 @@ olichtne(a)redhat.com (Ondrej Lichtner) """ -from lnst.Tests.Ping import Ping -from lnst.Tests.PacketAssert import PacketAssert -from lnst.Tests.Iperf import IperfClient, IperfServer +# from lnst.Tests.Ping import Ping +# from lnst.Tests.PacketAssert import PacketAssert +# from lnst.Tests.Iperf import IperfClient, IperfServer +import importlib + +lazy_load_modules = { + "Ping": "lnst.Tests.Ping", + "PacketAssert": "lnst.Tests.PacketAssert", + "IperfClient": "lnst.Tests.Iperf", + "IperfServer": "lnst.Tests.Iperf", +} + + +def __getattr__(name): + if name not in lazy_load_modules: + raise ImportError("Cannot import {}".format(name)) + mod = importlib.import_module(lazy_load_modules[name]) + globals()[name] = getattr(mod, name) + return globals()[name] + + +# #TODO add support for test classes from lnst-ctl.conf -#TODO add support for test classes from lnst-ctl.conf --- However this requires the ability to define __getattr__ for a module, which is introduced as a python3.7 feature via PEP562 [0]. -Ondrej [0] https://www.python.org/dev/peps/pep-0562/

2 3

[PATCH] IperfFlowMeasurement: fix parse_job_cpu duration get, again
by olichtne＠redhat.com 01 Feb '21

01 Feb '21

From: Ondrej Lichtner <olichtne(a)redhat.com> One more fix for accessing the test duration when parsing test results for cpu utilization of the iperf process. The json dictionaries are inconsistent between tcp/udp stream on how they report the end of test data - udp reports only a "sum" dictionary, tcp only reports a "sum_sent" and "sum_received" dictionaries. So instead we look at the test start and the *requested* test duration. Not as precise as the actual duration of the test but probably good enough considering how the duration is used in this case... Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py index 87ef70f..722b49e 100644 --- a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py +++ b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py @@ -187,5 +187,5 @@ def _parse_job_cpu(self, job): else: cpu_percent = job.result["data"]["end"]["cpu_utilization_percent"]["host_total"] job_start = job.result["data"]["start"]["timestamp"]["timesecs"] - duration = job.result["data"]["end"]["sum"]["seconds"] + duration = job.result["data"]["start"]["test_start"]["duration"] return PerfInterval(cpu_percent*duration, duration, "cpu_percent", job_start) -- 2.30.0

3 4

[PATCH] BaseFlowMeasurement: fix copy paste error in time_slice method
by olichtne＠redhat.com 29 Jan '21

29 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- lnst/RecipeCommon/Perf/Measurements/BaseFlowMeasurement.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lnst/RecipeCommon/Perf/Measurements/BaseFlowMeasurement.py b/lnst/RecipeCommon/Perf/Measurements/BaseFlowMeasurement.py index a8e9328..a798ca5 100644 --- a/lnst/RecipeCommon/Perf/Measurements/BaseFlowMeasurement.py +++ b/lnst/RecipeCommon/Perf/Measurements/BaseFlowMeasurement.py @@ -192,7 +192,7 @@ def time_slice(self, start, end): result_copy.receiver_cpu_stats = self.receiver_cpu_stats.time_slice(start, end) result_copy.generator_results = self.generator_results.time_slice(start, end) - result_copy.receiver_results = self.generator_results.time_slice(start, end) + result_copy.receiver_results = self.receiver_results.time_slice(start, end) return result_copy -- 2.30.0

3 2

[PATCH] IperfFlowMeasurement: fix dict key access
by olichtne＠redhat.com 28 Jan '21

28 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> Aparently when testing udp_stream, the "sum_received" key isn't defined and data is reported slightly differently. Instead the total duration can also be accessed from the "sum" subdictionary. Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py index e52f262..87ef70f 100644 --- a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py +++ b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py @@ -187,5 +187,5 @@ def _parse_job_cpu(self, job): else: cpu_percent = job.result["data"]["end"]["cpu_utilization_percent"]["host_total"] job_start = job.result["data"]["start"]["timestamp"]["timesecs"] - duration = job.result["data"]["end"]["sum_received"]["seconds"] + duration = job.result["data"]["end"]["sum"]["seconds"] return PerfInterval(cpu_percent*duration, duration, "cpu_percent", job_start) -- 2.30.0

2 1

[PATCH v2 1/2] *Measurement: add proper timestamp init where missing
by olichtne＠redhat.com 28 Jan '21

28 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> We shouldn't use "None" for initialization of timestamps as it breaks any time alignment/time slice related code that works with these results. Use current timestamp of the controller (code that creates the PerfResult object) as "good enough" in cases where no timestamp is returned from the Test tool used. Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- .../Perf/Measurements/IperfFlowMeasurement.py | 8 +++++--- .../Perf/Measurements/TRexFlowMeasurement.py | 9 +++++---- 2 files changed, 10 insertions(+), 7 deletions(-) diff --git a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py index 10088f4..e52f262 100644 --- a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py +++ b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py @@ -167,7 +167,7 @@ def _prepare_client(self, flow): def _parse_job_streams(self, job): result = ParallelPerfResult() if not job.passed: - result.append(PerfInterval(0, 0, "bits", None)) + result.append(PerfInterval(0, 0, "bits", time.time())) else: for i in job.result["data"]["end"]["streams"]: result.append(SequentialPerfResult()) @@ -183,7 +183,9 @@ def _parse_job_streams(self, job): def _parse_job_cpu(self, job): if not job.passed: - return PerfInterval(0, 0, "cpu_percent", None) + return PerfInterval(0, 0, "cpu_percent", time.time()) else: cpu_percent = job.result["data"]["end"]["cpu_utilization_percent"]["host_total"] - return PerfInterval(cpu_percent, 1, "cpu_percent", None) + job_start = job.result["data"]["start"]["timestamp"]["timesecs"] + duration = job.result["data"]["end"]["sum_received"]["seconds"] + return PerfInterval(cpu_percent*duration, duration, "cpu_percent", job_start) diff --git a/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py b/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py index b780842..dca58b1 100644 --- a/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py +++ b/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py @@ -147,10 +147,11 @@ def _parse_results_by_port(self, job, port, flow): results.receiver_cpu_stats = SequentialPerfResult() if not job.passed: - results.generator_results.append(PerfInterval(0, 0, "packets", None)) - results.generator_cpu_stats.append(PerfInterval(0, 0, "cpu_percent", None)) - results.receiver_results.append(PerfInterval(0, 0, "packets", None)) - results.receiver_cpu_stats.append(PerfInterval(0, 0, "cpu_percent", None)) + timestamp = time.time() + results.generator_results.append(PerfInterval(0, 0, "packets", timestamp)) + results.generator_cpu_stats.append(PerfInterval(0, 0, "cpu_percent", timestamp)) + results.receiver_results.append(PerfInterval(0, 0, "packets", timestamp)) + results.receiver_cpu_stats.append(PerfInterval(0, 0, "cpu_percent", timestamp)) else: prev_time = job.result["start_time"] prev_tx_val = 0 -- 2.30.0

3 3

[PATCH 1/3] Ping.Evaluators: fix evaluate_results method parameters
by olichtne＠redhat.com 27 Jan '21

27 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> The evaluate_results method signature changed in cd5328db8b0196a6102ebea54bdea1ce632cfe46 and the ping evaluators weren't updated... Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- lnst/RecipeCommon/Ping/Evaluators/RatePingEvaluator.py | 10 +++++++++- .../Ping/Evaluators/ZeroPassPingEvaluator.py | 10 +++++++++- 2 files changed, 18 insertions(+), 2 deletions(-) diff --git a/lnst/RecipeCommon/Ping/Evaluators/RatePingEvaluator.py b/lnst/RecipeCommon/Ping/Evaluators/RatePingEvaluator.py index 6760d32..f2a3dce 100644 --- a/lnst/RecipeCommon/Ping/Evaluators/RatePingEvaluator.py +++ b/lnst/RecipeCommon/Ping/Evaluators/RatePingEvaluator.py @@ -1,3 +1,6 @@ +from typing import List, Any + +from lnst.Controller.Recipe import BaseRecipe from lnst.RecipeCommon.BaseResultEvaluator import BaseResultEvaluator class RatePingEvaluator(BaseResultEvaluator): @@ -12,7 +15,12 @@ def __init__(self, min_rate=None, max_rate=None, rate=None): self.__class__.__name__) ) - def evaluate_results(self, recipe, result): + def evaluate_results( + self, + recipe: BaseRecipe, + recipe_conf: Any, + result: List[Any], + ): result_status = True ping_rate = int(result['rate']) diff --git a/lnst/RecipeCommon/Ping/Evaluators/ZeroPassPingEvaluator.py b/lnst/RecipeCommon/Ping/Evaluators/ZeroPassPingEvaluator.py index 350e157..afb3d02 100644 --- a/lnst/RecipeCommon/Ping/Evaluators/ZeroPassPingEvaluator.py +++ b/lnst/RecipeCommon/Ping/Evaluators/ZeroPassPingEvaluator.py @@ -1,7 +1,15 @@ +from typing import List, Any + +from lnst.Controller.Recipe import BaseRecipe from lnst.RecipeCommon.BaseResultEvaluator import BaseResultEvaluator class ZeroPassPingEvaluator(BaseResultEvaluator): - def evaluate_results(self, recipe, result): + def evaluate_results( + self, + recipe: BaseRecipe, + recipe_conf: Any, + result: List[Any], + ): result_status = True trans_packets = int(result['trans_pkts']) recv_packets = int(result['recv_pkts']) -- 2.30.0

3 10

[PATCH] TRexFlowMeasurement: add missing timestamp initialization to PerfInterval
by olichtne＠redhat.com 22 Jan '21

22 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- .../Perf/Measurements/TRexFlowMeasurement.py | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py b/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py index d96ecc9..b780842 100644 --- a/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py +++ b/lnst/RecipeCommon/Perf/Measurements/TRexFlowMeasurement.py @@ -147,10 +147,10 @@ def _parse_results_by_port(self, job, port, flow): results.receiver_cpu_stats = SequentialPerfResult() if not job.passed: - results.generator_results.append(PerfInterval(0, 0, "packets")) - results.generator_cpu_stats.append(PerfInterval(0, 0, "cpu_percent")) - results.receiver_results.append(PerfInterval(0, 0, "packets")) - results.receiver_cpu_stats.append(PerfInterval(0, 0, "cpu_percent")) + results.generator_results.append(PerfInterval(0, 0, "packets", None)) + results.generator_cpu_stats.append(PerfInterval(0, 0, "cpu_percent", None)) + results.receiver_results.append(PerfInterval(0, 0, "packets", None)) + results.receiver_cpu_stats.append(PerfInterval(0, 0, "cpu_percent", None)) else: prev_time = job.result["start_time"] prev_tx_val = 0 @@ -162,11 +162,11 @@ def _parse_results_by_port(self, job, port, flow): results.generator_results.append(PerfInterval( tx_delta, time_delta, - "pkts")) + "pkts", i["timestamp"])) results.receiver_results.append(PerfInterval( rx_delta, time_delta, - "pkts")) + "pkts", i["timestamp"])) prev_time = i["timestamp"] prev_tx_val = i["measurement"][port]["opackets"] @@ -176,9 +176,9 @@ def _parse_results_by_port(self, job, port, flow): results.generator_cpu_stats.append(PerfInterval( cpu_delta, time_delta, - "cpu_percent")) + "cpu_percent", i["timestamp"])) results.receiver_cpu_stats.append(PerfInterval( cpu_delta, time_delta, - "cpu_percent")) + "cpu_percent", i["timestamp"])) return results -- 2.30.0

3 2

[PATCH 1/2] Recipes.ENRT: move {idlestates,turboboost}_host_list properties
by olichtne＠redhat.com 22 Jan '21

22 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> Because the mixin classes for idlestates and turboboost disabling were moved to be inherited into the Baremetal and Virtual enrtrecipes base classes, the host list definition in BaseEnrtRecipe was being overriden by the higher placed base definition in the original mixin classes like this: SimpleNetworkRecipe -> Mixin -> BaseEnrtRecipe The base definition of the "host_list" just returns [], and doesn't call super so the definition from BaseEnrtRecipe was never called. This effectively disabled the mixins in all the enrt recipes that previously used them. Moving these to the new base classes of BaremetalEnrtRecipe and VirtualEnrtRecipe fixes the issue. Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- lnst/Recipes/ENRT/BaremetalEnrtRecipe.py | 24 +++++++++++++++++- lnst/Recipes/ENRT/BaseEnrtRecipe.py | 32 ------------------------ lnst/Recipes/ENRT/VirtualEnrtRecipe.py | 24 ++++++++++++++++++ 3 files changed, 47 insertions(+), 33 deletions(-) diff --git a/lnst/Recipes/ENRT/BaremetalEnrtRecipe.py b/lnst/Recipes/ENRT/BaremetalEnrtRecipe.py index da19095..59e222d 100644 --- a/lnst/Recipes/ENRT/BaremetalEnrtRecipe.py +++ b/lnst/Recipes/ENRT/BaremetalEnrtRecipe.py @@ -23,4 +23,26 @@ class BaremetalEnrtRecipe( IperfMeasurementGenerator, BaseEnrtRecipe, ): - pass + @property + def disable_idlestates_host_list(self): + """ + The `disable_idlestates_host_list` property value is the list of all + matched baremetal hosts for the recipe. + + For detailed explanation of this property see + :any:`DisableIdleStatesMixin` and + :any:`DisableIdleStatesMixin.disable_idlestates_host_list`. + """ + return self.matched + + @property + def disable_turboboost_host_list(self): + """ + The `disable_turboboost_host_list` property value is the list of all + matched baremetal hosts for the recipe. + + For detailed explanation of this property see + :any:`DisableTurboboostMixin` and + :any:`DisableTurboboostMixin.disable_turboboost_host_list`. + """ + return self.matched diff --git a/lnst/Recipes/ENRT/BaseEnrtRecipe.py b/lnst/Recipes/ENRT/BaseEnrtRecipe.py index 9813ba6..c263cfd 100644 --- a/lnst/Recipes/ENRT/BaseEnrtRecipe.py +++ b/lnst/Recipes/ENRT/BaseEnrtRecipe.py @@ -449,8 +449,6 @@ def condition(): self.ctl.wait_for_condition(condition, timeout=5) - - def _create_reverse_ping(self, pconf): return PingConf( client = pconf.destination, @@ -461,33 +459,3 @@ def _create_reverse_ping(self, pconf): interval = pconf.ping_interval, size = pconf.ping_psize, ) - - @property - def disable_turboboost_host_list(self): - """ - The `disable_turboboost_host_list` property value is the list of all - matched hosts for the recipe. If a specific recipe needs to change - this it should override the :any:`baremetal_hosts` property. - - For detailed explanation of this property see - :any:`DisableTurboboostMixin` and - :any:`DisableTurboboostMixin.disable_turboboost_host_list`. - """ - return self.baremetal_hosts - - @property - def disable_idlestates_host_list(self): - """ - The `disable_idlestates_host_list` property value is the list of all - matched hosts for the recipe. If a specific recipe needs to change - this it should override the :any:`baremetal_hosts` property. - - For detailed explanation of this property see - :any:`DisableIdleStatesMixin` and - :any:`DisableIdleStatesMixin.disable_idlestates_host_list`. - """ - return self.baremetal_hosts - - @property - def baremetal_hosts(self): - return self.matched diff --git a/lnst/Recipes/ENRT/VirtualEnrtRecipe.py b/lnst/Recipes/ENRT/VirtualEnrtRecipe.py index 82d6e3a..d706815 100644 --- a/lnst/Recipes/ENRT/VirtualEnrtRecipe.py +++ b/lnst/Recipes/ENRT/VirtualEnrtRecipe.py @@ -26,3 +26,27 @@ class VirtualEnrtRecipe( @property def hypervisor_hosts(self): return set([self.matched.host1, self.matched.host2]) + + @property + def disable_idlestates_host_list(self): + """ + The `disable_idlestates_host_list` property value is the list of all + matched baremetal hosts for the recipe. + + For detailed explanation of this property see + :any:`DisableIdleStatesMixin` and + :any:`DisableIdleStatesMixin.disable_idlestates_host_list`. + """ + return self.hypervisor_hosts + + @property + def disable_turboboost_host_list(self): + """ + The `disable_turboboost_host_list` property value is the list of all + matched baremetal hosts for the recipe. + + For detailed explanation of this property see + :any:`DisableTurboboostMixin` and + :any:`DisableTurboboostMixin.disable_turboboost_host_list`. + """ + return self.hypervisor_hosts -- 2.30.0

3 3

[PATCH] add sleep between start of iperf server and client
by Jan Tluka 22 Jan '21

22 Jan '21

Add a short delay before starting iperf client connection to server. This is to reduce probability of the iperf server not being able to start quick enough to handle the client connection. Fixes https://github.com/LNST-project/lnst/issues/200 Signed-off-by: Jan Tluka <jtluka(a)redhat.com> Signed-off-by: Ondrej Lichtner <olichtne(a)redhat.com> --- lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py | 1 + 1 file changed, 1 insertion(+) diff --git a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py index ed1f5371..ccfe17e3 100644 --- a/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py +++ b/lnst/RecipeCommon/Perf/Measurements/IperfFlowMeasurement.py @@ -62,6 +62,7 @@ class IperfFlowMeasurement(BaseFlowMeasurement): for flow in test_flows: flow.server_job.start(bg=True) + time.sleep(2) for flow in test_flows: flow.client_job.start(bg=True) -- 2.26.2

2 1

[PATCH] Tests.Iperf: use port in client command
by Jan Tluka 22 Jan '21

22 Jan '21

This updates the iperf client command to use the port specified similar to the server command. Signed-off-by: Jan Tluka <jtluka(a)redhat.com> --- lnst/Tests/Iperf.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/lnst/Tests/Iperf.py b/lnst/Tests/Iperf.py index bedeb518..483a9116 100644 --- a/lnst/Tests/Iperf.py +++ b/lnst/Tests/Iperf.py @@ -141,11 +141,12 @@ class IperfClient(IperfBase): test = "" cmd = ("iperf3 -c {server} -b 0/1000 -J -t {duration}" - " {cpu} {test} {mss} {blksize} {parallel}" + " {cpu} {test} {mss} {blksize} {parallel} {port}" " {opts}".format( server=self.params.server, duration=self.params.duration, cpu=cpu, test=test, mss=mss, blksize=blksize, parallel=parallel, + port=port, opts=self.params.opts if "opts" in self.params else "")) return cmd -- 2.26.2

2 1

[PATCH] Tests.Iperf: add missing initialization of oneoff iperf parameter
by Jan Tluka 22 Jan '21

22 Jan '21

If parameter 'oneoff' is not specified, the default value False is used and consequently None is passed as value of oneoff variable because the initialization of the variable is skipped. Signed-off-by: Jan Tluka <jtluka(a)redhat.com> --- lnst/Tests/Iperf.py | 1 + 1 file changed, 1 insertion(+) diff --git a/lnst/Tests/Iperf.py b/lnst/Tests/Iperf.py index db8f38d1..bedeb518 100644 --- a/lnst/Tests/Iperf.py +++ b/lnst/Tests/Iperf.py @@ -60,6 +60,7 @@ class IperfServer(IperfBase): def _compose_cmd(self): bind = "" port = "" + oneoff = "" if "bind" in self.params: bind = "-B {}".format(self.params.bind) -- 2.26.2

2 1

[PATCH 0/11] ENRT Measurements and Perf refactoring
by olichtne＠redhat.com 15 Jan '21

15 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> Hi all, this is the final version of the patchset, the only change is that it was rebased on top of the current upstream master which included resolving a simple merge conflict in the commit "RecipeCommon.Perf: add typehints and use black to reformat code" Everything else is the same, I have tested the patchset on all the recipes that we have in the ENRT package and so I will be proceeding with pushing this to master. -Ondrej Ondrej Lichtner (11): RecipeCommon.Perf.Measurements: add flows property to FlowMeasurements RecipeCommon.Perf.Measurements.StatCPUMeasurement: sort hosts create lnst.Recipes.ENRT.MeasurementGenerators Recipes.ENRT.BaseEnrtRecipe: remove perf measurement generation add lnst.Recipes.ENRT.BaremetalEnrtRecipe add lnst.Recipes.ENRT.VirtualEnrtRecipe refactor lnst.Recipes.ENRT.BaseEnrtRecipe lnst.RecipeCommon.Perf: Evaluators refactor to add parent recipe configuration RecipeCommon.Perf.RecipeConf: add parent recipe reference RecipeCommon.Perf: add typehints and use black to reformat code Perf.Measurements: remove measurement_conf from *Measurement initialization lnst/RecipeCommon/BaseResultEvaluator.py | 12 +- .../Evaluators/BaselineCPUAverageEvaluator.py | 45 ++++- .../Perf/Evaluators/BaselineEvaluator.py | 77 ++++++-- .../BaselineFlowAverageEvaluator.py | 37 +++- .../Perf/Evaluators/NonzeroFlowEvaluator.py | 18 +- .../Perf/Measurements/BaseFlowMeasurement.py | 4 + .../Perf/Measurements/BaseMeasurement.py | 13 +- .../Perf/Measurements/IperfFlowMeasurement.py | 13 +- .../Perf/Measurements/StatCPUMeasurement.py | 11 +- .../Perf/Measurements/TRexFlowMeasurement.py | 14 +- lnst/RecipeCommon/Perf/Recipe.py | 129 +++++++++---- lnst/Recipes/ENRT/BaremetalEnrtRecipe.py | 26 +++ lnst/Recipes/ENRT/BaseEnrtRecipe.py | 178 +++--------------- lnst/Recipes/ENRT/BondRecipe.py | 4 +- lnst/Recipes/ENRT/DoubleBondRecipe.py | 4 +- lnst/Recipes/ENRT/DoubleTeamRecipe.py | 4 +- lnst/Recipes/ENRT/IpsecEspAeadRecipe.py | 4 +- lnst/Recipes/ENRT/IpsecEspAhCompRecipe.py | 4 +- .../BaseMeasurementGenerator.py | 3 + ...lowEndpointsStatCPUMeasurementGenerator.py | 26 +++ .../HypervisorsStatCPUMeasurementGenerator.py | 19 ++ .../IperfMeasurementGenerator.py | 146 ++++++++++++++ .../ENRT/MeasurementGenerators/__init__.py | 0 lnst/Recipes/ENRT/NoVirtOvsVxlanRecipe.py | 4 +- .../SctpFirewallPerfTestMixin.py | 4 +- .../UdpFragmentationPerfTestMixin.py | 2 +- .../ENRT/ShortLivedConnectionsRecipe.py | 4 +- lnst/Recipes/ENRT/SimpleMacsecRecipe.py | 4 +- lnst/Recipes/ENRT/SimpleNetworkRecipe.py | 7 +- lnst/Recipes/ENRT/TeamRecipe.py | 4 +- lnst/Recipes/ENRT/TeamVsBondRecipe.py | 4 +- lnst/Recipes/ENRT/VirtOvsVxlanRecipe.py | 4 +- .../VirtualBridgeVlanInGuestMirroredRecipe.py | 4 +- .../ENRT/VirtualBridgeVlanInGuestRecipe.py | 4 +- .../VirtualBridgeVlanInHostMirroredRecipe.py | 4 +- .../ENRT/VirtualBridgeVlanInHostRecipe.py | 4 +- .../ENRT/VirtualBridgeVlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VirtualEnrtRecipe.py | 28 +++ ...rtualOvsBridgeVlanInGuestMirroredRecipe.py | 4 +- .../ENRT/VirtualOvsBridgeVlanInGuestRecipe.py | 4 +- ...irtualOvsBridgeVlanInHostMirroredRecipe.py | 4 +- .../ENRT/VirtualOvsBridgeVlanInHostRecipe.py | 4 +- .../VirtualOvsBridgeVlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VlansOverTeamRecipe.py | 4 +- lnst/Recipes/ENRT/VlansRecipe.py | 4 +- lnst/Recipes/ENRT/VxlanMulticastRecipe.py | 4 +- lnst/Recipes/ENRT/VxlanRemoteRecipe.py | 4 +- 48 files changed, 610 insertions(+), 306 deletions(-) create mode 100644 lnst/Recipes/ENRT/BaremetalEnrtRecipe.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/BaseMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/FlowEndpointsStatCPUMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/HypervisorsStatCPUMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/IperfMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/__init__.py create mode 100644 lnst/Recipes/ENRT/VirtualEnrtRecipe.py -- 2.30.0

2 12

[PATCH v2 0/9] Measurement results alignment
by Jan Tluka 14 Jan '21

14 Jan '21

Following patchset implements a measurement results alignment required for more complex measurement scenarios where a delay between starting the first and last measurements can result in counting in data that are not relevant. The approach is quite simple. Every class that inherit from BaseMeasurementResults can override align_data method that should return a copy of the class with measurement data aligned within a time. The patchset extends only the FlowMeasurementResults and StatCPUMeasurementResults classes so that most of the ENRT recipes can benefit from this change. Jan Tluka (9): Tests.CPUStatMonitor: add timestamp into measured interval RecipeCommon.Perf.Results.PerfInterval: add timestamp property RecipeCommon.Perf.Measurements.StatCPUMeasurementResults: add start_timestamp and end_timestamp property RecipeCommon.Perf.Measurements.FlowMeasurementResults: add start_timestamp and end_timestamp properties RecipeCommon.Perf.Measurements.BaseMeasurement: add align_data method RecipeCommon.Perf.Measurements.BaseFlowMeasurement: override align_data method RecipeCommon.Perf.Measurements.StatCPUMeasurement: override align_data method RecipeCommon.Perf.Recipe: keep both aggregated and individual results lnst.RecipeCommon.Perf.Recipe: report and evaluate aligned results .../Perf/Measurements/BaseFlowMeasurement.py | 41 +++++++++++++++ .../Perf/Measurements/BaseMeasurement.py | 3 ++ .../Perf/Measurements/IperfFlowMeasurement.py | 10 ++-- .../Perf/Measurements/StatCPUMeasurement.py | 32 ++++++++++-- lnst/RecipeCommon/Perf/Recipe.py | 51 ++++++++++++++++--- lnst/RecipeCommon/Perf/Results.py | 7 ++- lnst/Tests/CPUStatMonitor.py | 1 + 7 files changed, 131 insertions(+), 14 deletions(-) -- 2.26.2

2 10

[PATCH 0/9] Measurement results alignment
by Jan Tluka 13 Jan '21

13 Jan '21

Following patchset implements a measurement results alignment required for more complex measurement scenarios where a delay between starting the first and last measurements can result in counting in data that are not relevant. The approach is quite simple. Every class that inherit from BaseMeasurementResults can override align_data method that should return a copy of the class with measurement data aligned within a time. The patchset extends only the FlowMeasurementResults and StatCPUMeasurementResults classes so that most of the ENRT recipes can benefit from this change. Jan Tluka (9): Tests.CPUStatMonitor: add timestamp into measured interval RecipeCommon.Perf.Results.PerfInterval: add timestamp property RecipeCommon.Perf.Measurements.StatCPUMeasurementResults: add start_timestamp and end_timestamp property RecipeCommon.Perf.Measurements.FlowMeasurementResults: add start_timestamp and end_timestamp properties RecipeCommon.Perf.Measurements.BaseMeasurement: add align_data method RecipeCommon.Perf.Measurements.BaseFlowMeasurement: override align_data method RecipeCommon.Perf.Measurements.StatCPUMeasurement: override align_data method RecipeCommon.Perf.Recipe: keep both aggregated and individual results lnst.RecipeCommon.Perf.Recipe: report and evaluate aligned results .../Perf/Measurements/BaseFlowMeasurement.py | 46 ++++++++++++++++ .../Perf/Measurements/BaseMeasurement.py | 3 ++ .../Perf/Measurements/IperfFlowMeasurement.py | 10 ++-- .../Perf/Measurements/StatCPUMeasurement.py | 34 ++++++++++-- lnst/RecipeCommon/Perf/Recipe.py | 52 ++++++++++++++++--- lnst/RecipeCommon/Perf/Results.py | 7 ++- lnst/Tests/CPUStatMonitor.py | 1 + 7 files changed, 139 insertions(+), 14 deletions(-) -- 2.26.2

2 25

[PATCH 0/11] ENRT Measurements and Perf refactoring
by olichtne＠redhat.com 12 Jan '21

12 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> Hi all, as promised, this is the updated second version of my patchset from last year. This should now be a good enough version to apply. The main chages are: * split evaluator refactoring into separate patch from commit adding type hinting and black reformatting * more complete type hinting for the lnst.RecipeCommon.Perf package * remove measurement_conf from *Measurement init - new commit based on coments from Jan to the previous patchset Info from previous cover letter (copy pasted): This is the first version of a patchset to refactor the Recipes.ENRT package to make it more flexible wrt. generating measurements, this is a pain point that we've hit with different type of recipes that we already have: * baremetal recipes, generating relatively simple iperf flows * virtual recipes, being very similar however requiring different cpu measurements generated along these flow measurements * ipsec type recipes that generate more complex iperf flows * ovs+dpdk type recipes that due to using trex have their own quirks This version of the patchset was focused on adding support for the second bullet in the list - the virtual recipes, and making sure that baremetal recipes still work. Ipsec recipes should still work the same way, the ovs+dpdk recipes; however, likely require additional work. There's also a note in the final commit that more work on adding type hints to the Perf.* package. And finally... documentation has not been updated and will be added in the second version of the patchset. Please take a look and provide any valuable feedback that I should work on in the second version of the set. -Ondrej Ondrej Lichtner (11): RecipeCommon.Perf.Measurements: add flows property to FlowMeasurements RecipeCommon.Perf.Measurements.StatCPUMeasurement: sort hosts create lnst.Recipes.ENRT.MeasurementGenerators Recipes.ENRT.BaseEnrtRecipe: remove perf measurement generation add lnst.Recipes.ENRT.BaremetalEnrtRecipe add lnst.Recipes.ENRT.VirtualEnrtRecipe refactor lnst.Recipes.ENRT.BaseEnrtRecipe lnst.RecipeCommon.Perf: Evaluators refactor to add parent recipe configuration RecipeCommon.Perf.RecipeConf: add parent recipe reference RecipeCommon.Perf: add typehints and use black to reformat code Perf.Measurements: remove measurement_conf from *Measurement initialization lnst/RecipeCommon/BaseResultEvaluator.py | 16 +- .../Evaluators/BaselineCPUAverageEvaluator.py | 45 ++++- .../Perf/Evaluators/BaselineEvaluator.py | 77 ++++++-- .../BaselineFlowAverageEvaluator.py | 37 +++- .../Perf/Evaluators/NonzeroFlowEvaluator.py | 18 +- .../Perf/Measurements/BaseFlowMeasurement.py | 4 + .../Perf/Measurements/BaseMeasurement.py | 7 +- .../Perf/Measurements/IperfFlowMeasurement.py | 13 +- .../Perf/Measurements/StatCPUMeasurement.py | 11 +- .../Perf/Measurements/TRexFlowMeasurement.py | 14 +- lnst/RecipeCommon/Perf/Recipe.py | 82 +++++--- lnst/Recipes/ENRT/BaremetalEnrtRecipe.py | 26 +++ lnst/Recipes/ENRT/BaseEnrtRecipe.py | 178 +++--------------- lnst/Recipes/ENRT/BondRecipe.py | 4 +- lnst/Recipes/ENRT/DoubleBondRecipe.py | 4 +- lnst/Recipes/ENRT/DoubleTeamRecipe.py | 4 +- lnst/Recipes/ENRT/IpsecEspAeadRecipe.py | 4 +- lnst/Recipes/ENRT/IpsecEspAhCompRecipe.py | 4 +- .../BaseMeasurementGenerator.py | 3 + ...lowEndpointsStatCPUMeasurementGenerator.py | 26 +++ .../HypervisorsStatCPUMeasurementGenerator.py | 19 ++ .../IperfMeasurementGenerator.py | 146 ++++++++++++++ .../ENRT/MeasurementGenerators/__init__.py | 0 lnst/Recipes/ENRT/NoVirtOvsVxlanRecipe.py | 4 +- .../ENRT/ShortLivedConnectionsRecipe.py | 4 +- lnst/Recipes/ENRT/SimpleMacsecRecipe.py | 4 +- lnst/Recipes/ENRT/SimpleNetworkRecipe.py | 7 +- lnst/Recipes/ENRT/TeamRecipe.py | 4 +- lnst/Recipes/ENRT/TeamVsBondRecipe.py | 4 +- lnst/Recipes/ENRT/VirtOvsVxlanRecipe.py | 4 +- .../VirtualBridgeVlanInGuestMirroredRecipe.py | 4 +- .../ENRT/VirtualBridgeVlanInGuestRecipe.py | 4 +- .../VirtualBridgeVlanInHostMirroredRecipe.py | 4 +- .../ENRT/VirtualBridgeVlanInHostRecipe.py | 4 +- .../ENRT/VirtualBridgeVlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VirtualEnrtRecipe.py | 28 +++ ...rtualOvsBridgeVlanInGuestMirroredRecipe.py | 4 +- .../ENRT/VirtualOvsBridgeVlanInGuestRecipe.py | 4 +- ...irtualOvsBridgeVlanInHostMirroredRecipe.py | 4 +- .../ENRT/VirtualOvsBridgeVlanInHostRecipe.py | 4 +- .../VirtualOvsBridgeVlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VlansOverTeamRecipe.py | 4 +- lnst/Recipes/ENRT/VlansRecipe.py | 4 +- lnst/Recipes/ENRT/VxlanMulticastRecipe.py | 4 +- lnst/Recipes/ENRT/VxlanRemoteRecipe.py | 4 +- 46 files changed, 579 insertions(+), 282 deletions(-) create mode 100644 lnst/Recipes/ENRT/BaremetalEnrtRecipe.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/BaseMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/FlowEndpointsStatCPUMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/HypervisorsStatCPUMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/IperfMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/__init__.py create mode 100644 lnst/Recipes/ENRT/VirtualEnrtRecipe.py -- 2.29.2

3 13

[PATCH 1/2] lnst.Recipes.ENRT.OvS_DPDK_PvP: add missing parameter
by jurbanov＠redhat.com 12 Jan '21

12 Jan '21

From: Jozef Urbanovsky <jurbanov(a)redhat.com> After introduction of the OvSDPDKBondRecipe the test module testPMD requires forward_mode parameter. Signed-off-by: Jozef Urbanovsky <jurbanov(a)redhat.com> --- lnst/Recipes/ENRT/OvS_DPDK_PvP.py | 1 + 1 file changed, 1 insertion(+) diff --git a/lnst/Recipes/ENRT/OvS_DPDK_PvP.py b/lnst/Recipes/ENRT/OvS_DPDK_PvP.py index 4e2aa00..c661320 100644 --- a/lnst/Recipes/ENRT/OvS_DPDK_PvP.py +++ b/lnst/Recipes/ENRT/OvS_DPDK_PvP.py @@ -118,6 +118,7 @@ class OvSDPDKPvPRecipe(BasePvPRecipe): TestPMD( coremask=self.params.guest_testpmd_cores, pmd_coremask=self.params.guest_dpdk_cores, + forward_mode="mac", nics=[nic.bus_info for nic in config.guest.nics], peer_macs=[nic.hwaddr for nic in config.generator.nics]), bg=True) -- 2.29.2

2 2

开发票 l3690131927
by dfetry＠hotmail.com 08 Jan '21

08 Jan '21

开发票 l3690131927 微信同号

1 0

[PATCH 1/2] lnst.Recipes.ENRT.OvSDPDKBondRecipe: fix parameter name
by jurbanov＠redhat.com 08 Jan '21

08 Jan '21

From: Jozef Urbanovsky <jurbanov(a)redhat.com> Signed-off-by: Jozef Urbanovsky <jurbanov(a)redhat.com> --- lnst/Recipes/ENRT/OvSDPDKBondRecipe.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lnst/Recipes/ENRT/OvSDPDKBondRecipe.py b/lnst/Recipes/ENRT/OvSDPDKBondRecipe.py index 2c3eb88..e2de29f 100644 --- a/lnst/Recipes/ENRT/OvSDPDKBondRecipe.py +++ b/lnst/Recipes/ENRT/OvSDPDKBondRecipe.py @@ -188,7 +188,7 @@ class OvSDPDKBondRecipe(BaseEnrtRecipe): TestPMD( coremask=self.params.testpmd_cores, pmd_coremask=self.params.testpmd_dpdk_cores, - mode="macswap", + forward_mode="macswap", nics=["vhost0", "vhost1"]), bg=True) -- 2.29.2

2 2

[PATCH v2 0/6] add OvSDPDKBondRecipe
by jurbanov＠redhat.com 06 Jan '21

06 Jan '21

From: Jozef Urbanovsky <jurbanov(a)redhat.com> Hi and Happy New Year, This patchset adds OvSDPDKBondRecipe and fixes some issues with test tools required for the recipe. Patchset has been reviewed in internal downstream, before it was decided to split it to upstream and downstream. V2 includes additional docstrings in OvSDPDKBondRecipe and some minor visual fixes. Jozef Urbanovsky (6): lnst.Recipes.ENRT.OvSDPDKBondRecipe: add new recipe lnst.Tests.TestPMD: add mode branching lnst.Tests.TRex: add __repr__ methods, expose module parameter lnst.RecipeCommon.Perf.Measurements.TRexFlowMeasurement: fixes requirements: add dataclasses package lnst.Recipes.ENRT.OvSDPDKBondRecipe: override *test_tweak methods .../Perf/Measurements/TRexFlowMeasurement.py | 5 +- lnst/Recipes/ENRT/OvSDPDKBondRecipe.py | 390 ++++++++++++++++++ lnst/Recipes/ENRT/__init__.py | 1 + lnst/Tests/TRex.py | 27 ++ lnst/Tests/TestPMD.py | 36 +- requirements.txt | 1 + 6 files changed, 448 insertions(+), 12 deletions(-) create mode 100644 lnst/Recipes/ENRT/OvSDPDKBondRecipe.py -- 2.29.2

3 10

[PATCH v2] lnst.Tests.TestPMD: add forward_mode branching
by jurbanov＠redhat.com 05 Jan '21

05 Jan '21

From: Jozef Urbanovsky <jurbanov(a)redhat.com> Adding parameter for the forward-mode selection of the testPMD application running during the recipe. Branching is currently supporting only "mac" and "macswap" forward modes. Signed-off-by: Jozef Urbanovsky <jurbanov(a)redhat.com> --- lnst/Tests/TestPMD.py | 36 ++++++++++++++++++++++++++---------- 1 file changed, 26 insertions(+), 10 deletions(-) diff --git a/lnst/Tests/TestPMD.py b/lnst/Tests/TestPMD.py index a92a42a..44c234f 100644 --- a/lnst/Tests/TestPMD.py +++ b/lnst/Tests/TestPMD.py @@ -4,27 +4,43 @@ import signal from lnst.Common.Parameters import Param, StrParam, IntParam, FloatParam from lnst.Common.Parameters import IpParam, DeviceOrIpParam from lnst.Tests.BaseTestModule import BaseTestModule, TestModuleError +from lnst.Common.LnstError import LnstError + class TestPMD(BaseTestModule): coremask = StrParam(mandatory=True) pmd_coremask = StrParam(mandatory=True) - #TODO make ListParam + # TODO make ListParam + foward_mode = StrParam(mandatory=True) nics = Param(mandatory=True) - peer_macs = Param(mandatory=True) + peer_macs = Param(mandatory=False) def format_command(self): - testpmd_args = ["testpmd", - "-c", self.params.coremask, - "-n", "4", "--socket-mem", "1024,0"] - for nic in self.params.nics: - testpmd_args.extend(["-w", nic]) + if self.params.forward_mode == "macswap": + testpmd_args = ["dpdk-testpmd", "--no-pci"] + else: + testpmd_args = ["testpmd"] + + testpmd_args.extend(["-c", self.params.coremask, + "-n", "4", "--socket-mem", "1024,0"]) + + for i, nic in enumerate(self.params.nics): + if self.params.foward_mode == "mac": + testpmd_args.extend(["-w", nic]) + elif self.params.foward_mode == "macswap": + testpmd_args.extend([f"--vdev=net_virtio_user{i+1},path=/var/run/openvswitch/{nic}"]) + else: + LnstError("Unsupported forward-mode parameter selected for the TestPMD.") - testpmd_args.extend(["--", "-i", "--forward-mode", "mac", + testpmd_args.extend(["--", "-i", "--forward-mode", self.params.foward_mode, "--coremask", self.params.pmd_coremask]) - for i, mac in enumerate(self.params.peer_macs): - testpmd_args.extend(["--eth-peer", "{},{}".format(i, mac)]) + if self.params.foward_mode == "mac": + for i, mac in enumerate(self.params.peer_macs): + testpmd_args.extend(["--eth-peer", "{},{}".format(i, mac)]) + elif self.params.foward_mode == "macswap": + testpmd_args.extend(["--port-topology=loop"]) return " ".join(testpmd_args) -- 2.29.2

1 0

[RFC PATCH 0/8] ENRT Measurements and Perf refactoring
by olichtne＠redhat.com 04 Jan '21

04 Jan '21

From: Ondrej Lichtner <olichtne(a)redhat.com> Hi all, This patchset is therefore NOT COMPLETE AND NOT FIT TO APPLY YET, I'm seding this now to get an early round of reviews... This is the first version of a patchset to refactor the Recipes.ENRT package to make it more flexible wrt. generating measurements, this is a pain point that we've hit with different type of recipes that we already have: * baremetal recipes, generating relatively simple iperf flows * virtual recipes, being very similar however requiring different cpu measurements generated along these flow measurements * ipsec type recipes that generate more complex iperf flows * ovs+dpdk type recipes that due to using trex have their own quirks This version of the patchset was focused on adding support for the second bullet in the list - the virtual recipes, and making sure that baremetal recipes still work. Ipsec recipes should still work the same way, the ovs+dpdk recipes; however, likely require additional work. There's also a note in the final commit that more work on adding type hints to the Perf.* package. And finally... documentation has not been updated and will be added in the second version of the patchset. Please take a look and provide any valuable feedback that I should work on in the second version of the set. -Ondrej Ondrej Lichtner (8): RecipeCommon.Perf.Measurements: add flows property to FlowMeasurements RecipeCommon.Perf.Measurements.StatCPUMeasurement: sort hosts create lnst.Recipes.ENRT.MeasurementGenerators Recipes.ENRT.BaseEnrtRecipe: remove perf measurement generation add lnst.Recipes.ENRT.BaremetalEnrtRecipe add lnst.Recipes.ENRT.VirtualEnrtRecipe refactor lnst.Recipes.ENRT.BaseEnrtRecipe lnst.RecipeCommon.Perf: Evaluators refactor to add parent recipe configuration lnst/RecipeCommon/BaseResultEvaluator.py | 9 +- .../Evaluators/BaselineCPUAverageEvaluator.py | 39 +++- .../Perf/Evaluators/BaselineEvaluator.py | 77 ++++++-- .../BaselineFlowAverageEvaluator.py | 25 ++- .../Perf/Evaluators/NonzeroFlowEvaluator.py | 18 +- .../Perf/Measurements/BaseFlowMeasurement.py | 4 + .../Perf/Measurements/IperfFlowMeasurement.py | 4 + .../Perf/Measurements/StatCPUMeasurement.py | 2 +- .../Perf/Measurements/TRexFlowMeasurement.py | 4 + lnst/RecipeCommon/Perf/Recipe.py | 64 +++++-- lnst/Recipes/ENRT/BaremetalEnrtRecipe.py | 26 +++ lnst/Recipes/ENRT/BaseEnrtRecipe.py | 178 +++--------------- lnst/Recipes/ENRT/BondRecipe.py | 4 +- lnst/Recipes/ENRT/DoubleBondRecipe.py | 4 +- lnst/Recipes/ENRT/DoubleTeamRecipe.py | 4 +- lnst/Recipes/ENRT/IpsecEspAeadRecipe.py | 4 +- lnst/Recipes/ENRT/IpsecEspAhCompRecipe.py | 4 +- .../BaseMeasurementGenerator.py | 3 + ...lowEndpointsStatCPUMeasurementGenerator.py | 26 +++ .../HypervisorsStatCPUMeasurementGenerator.py | 19 ++ .../IperfMeasurementGenerator.py | 146 ++++++++++++++ .../ENRT/MeasurementGenerators/__init__.py | 0 lnst/Recipes/ENRT/NoVirtOvsVxlanRecipe.py | 4 +- .../ENRT/ShortLivedConnectionsRecipe.py | 4 +- lnst/Recipes/ENRT/SimpleMacsecRecipe.py | 4 +- lnst/Recipes/ENRT/SimpleNetworkRecipe.py | 7 +- lnst/Recipes/ENRT/TeamRecipe.py | 4 +- lnst/Recipes/ENRT/TeamVsBondRecipe.py | 4 +- lnst/Recipes/ENRT/VirtOvsVxlanRecipe.py | 4 +- .../VirtualBridgeVlanInGuestMirroredRecipe.py | 4 +- .../ENRT/VirtualBridgeVlanInGuestRecipe.py | 4 +- .../VirtualBridgeVlanInHostMirroredRecipe.py | 4 +- .../ENRT/VirtualBridgeVlanInHostRecipe.py | 4 +- .../ENRT/VirtualBridgeVlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VirtualEnrtRecipe.py | 28 +++ ...rtualOvsBridgeVlanInGuestMirroredRecipe.py | 4 +- .../ENRT/VirtualOvsBridgeVlanInGuestRecipe.py | 4 +- ...irtualOvsBridgeVlanInHostMirroredRecipe.py | 4 +- .../ENRT/VirtualOvsBridgeVlanInHostRecipe.py | 4 +- .../VirtualOvsBridgeVlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VlansOverBondRecipe.py | 4 +- lnst/Recipes/ENRT/VlansOverTeamRecipe.py | 4 +- lnst/Recipes/ENRT/VlansRecipe.py | 4 +- lnst/Recipes/ENRT/VxlanMulticastRecipe.py | 4 +- lnst/Recipes/ENRT/VxlanRemoteRecipe.py | 4 +- 45 files changed, 528 insertions(+), 255 deletions(-) create mode 100644 lnst/Recipes/ENRT/BaremetalEnrtRecipe.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/BaseMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/FlowEndpointsStatCPUMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/HypervisorsStatCPUMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/IperfMeasurementGenerator.py create mode 100644 lnst/Recipes/ENRT/MeasurementGenerators/__init__.py create mode 100644 lnst/Recipes/ENRT/VirtualEnrtRecipe.py -- 2.29.2

3 15

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

LNST-developers January 2021