首页 \ 问答 \ PySpark DataFrame过滤器使用条件列表上的逻辑AND(PySpark DataFrame filter using logical AND over a list of conditions)

PySpark DataFrame过滤器使用条件列表上的逻辑AND(PySpark DataFrame filter using logical AND over a list of conditions)

 我正在尝试过滤所有列的值为零的PySpark数据帧的行。  
 我希望使用这样的东西：  
from pyspark.sql.functions import col
df.filter(all([(col(c) != 0) for c in df.columns]))
 
 但我得到一个ValueError：  
ValueError: Cannot convert column into bool: please use '&' for 'and', '|' for 'or', '~' for 'not' when building DataFrame boolean expressions.
 
 有没有办法执行逻辑和条件列表？ 

I'm trying to filter rows of a PySpark dataframe where the values of all columns are zero. 
I was hoping to use something like this: 
from pyspark.sql.functions import col
df.filter(all([(col(c) != 0) for c in df.columns]))
 
But I get a ValueError: 
ValueError: Cannot convert column into bool: please use '&' for 'and', '|' for 'or', '~' for 'not' when building DataFrame boolean expressions.
 
Is there any way to perform the logical and on a list of conditions?

原文：https://stackoverflow.com/questions/41239629

更新时间：2023-08-25 17:08

最满意答案

 WebCryptographyApi在Android WebView上不受支持，并且webcrypto-shim不针对此组件  
 
  该库旨在修复这些具有前缀和错误的webcrypto api实现的浏览器：  
  Internet Explorer 11，移动Internet Explorer 11，Safari 8及iOS Safari 8及更高版本。  
 
 所以你得到了预期的行为。 我认为显示Cordova的window.crypto是旧的实现。  
 如果您需要密钥存储，我建议使用Android本机密钥库（如果您为其构建，则使用iOS）。 如果您正在寻找加密函数，请包含一个纯JavaScript库 

After more research and tests I have found a pure js library that works on cordova. 
jsrsasign 
I used it to authentificate my JWT. It doesn't use the the crypto.subtle module. 
        // Header
        var oHeader = { alg: 'HS256', typ: 'JWT' };
        // Payload
        var oPayload = {};
        var tNow = KJUR.jws.IntDate.get('now');
        var tEnd = KJUR.jws.IntDate.get('now + 1day');
        oPayload.iss = "http://foobar.com";
        oPayload.sub = "mailto:someone@hello.com";
        oPayload.iat = tNow;
        oPayload.exp = tEnd;
        oPayload.jti = "id123";
        oPayload.aud = "http://someUrl";
        oPayload.email = "userEmail";
        oPayload.pwd = "userPassword";
        oPayload.deviceId = "deviceId";

        // Sign JWT.
        var sHeader = JSON.stringify(oHeader);
        var sPayload = JSON.stringify(oPayload);
        //secret -> your secret that the server gave you.
        var sJWT = KJUR.jws.JWS.sign("HS256", sHeader, sPayload, secret);
        console.log(sJWT);
 
So that's it. It solved my problem.
 I know that the undefined crypto.subtle error still exists. I did not find any solutions to that problem.
 I supose that one day the developers in charge of cordova will make the effort to support the cryto module that we can find in all other browser but for now the only solution is to used third party libraries.

PySpark DataFrame过滤器使用条件列表上的逻辑AND(PySpark DataFrame filter using logical AND over a list of conditions)

最满意答案

相关问答

使用WebAPI window.crypto.subtle.encrypt（）加密数据时出现TypeError(TypeError when encrypting data using the WebAPI window.crypto.subtle.encrypt())[2022-02-17]

MVC：不存在的操作(MVC: actions that don't exist)[2023-07-22]

计算不存在的日期(Counting dates that don't exist)[2022-10-20]

IE 10和android 4.x上的webcrypto解决方案(webcrypto solution on IE 10 and android 4.x)[2022-08-09]

如何在Chrome中为unsecure origin启用crypto.subtle？(How to enable crypto.subtle for unsecure origins in Chrome?)[2022-12-23]

选择不存在的东西(Select back things that don't exist)[2022-04-25]

使用用户提交的密码进行WebCrypto字符串加密(WebCrypto string encryption using user-submitted password)[2022-04-13]

仅保存不存在的记录(Only save the records that don't exist)[2021-09-30]

即使使用webcrypto-shim，crypto.subtle也不存在(crypto.subtle don't exist even with webcrypto-shim)[2022-12-16]

为什么python photoimages不存在？(Why photoimages don't exist?)[2022-09-01]

相关文章

最新问答